-- Logs begin at Sat 2022-08-06 00:38:58 UTC, end at Sat 2022-08-06 01:58:44 UTC. -- Aug 06 01:24:40.114422 dv-cinder-852009-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 01:24:40.123005 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 01:24:40 2022] *** Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: nodename: dv-cinder-852009-1-iscsi Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: machine: x86_64 Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: clock source: unix Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: pcre jit disabled Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: detected number of CPU cores: 4 Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: current working directory: / Aug 06 01:24:40.124985 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: detected binary path: /usr/bin/uwsgi-core Aug 06 01:24:40.125613 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: your processes number limit is 47680 Aug 06 01:24:40.125613 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: your memory page size is 4096 bytes Aug 06 01:24:40.125613 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: detected max file descriptor number: 2048 Aug 06 01:24:40.125613 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: lock engine: pthread robust mutexes Aug 06 01:24:40.125824 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: thunder lock: enabled Aug 06 01:24:40.126007 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 01:24:40.126007 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 01:24:40.165339 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: Python main interpreter initialized at 0x555742b019c0 Aug 06 01:24:40.165339 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: python threads support enabled Aug 06 01:24:40.165339 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: your server socket listen backlog is limited to 100 connections Aug 06 01:24:40.165339 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: your mercy for graceful operations on workers is 90 seconds Aug 06 01:24:40.165705 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 01:24:40.165784 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: *** Operational MODE: preforking *** Aug 06 01:24:40.165996 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: *** uWSGI is running in multiple interpreter mode *** Aug 06 01:24:40.165996 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: spawned uWSGI master process (pid: 103205) Aug 06 01:24:40.166188 dv-cinder-852009-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 01:24:40.167548 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: spawned uWSGI worker 1 (pid: 103206, cores: 1) Aug 06 01:24:40.167548 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: spawned uWSGI worker 2 (pid: 103207, cores: 1) Aug 06 01:24:40.167548 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 01:24:40.825848 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 01:24:40.827402 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 01:24:41.914386 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:24:41.914386 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: from cryptography.utils import int_from_bytes Aug 06 01:24:41.914993 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:24:41.914993 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: from cryptography.utils import int_from_bytes Aug 06 01:24:41.915439 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:24:41.915439 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: from cryptography.utils import int_from_bytes Aug 06 01:24:41.915876 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:24:41.915876 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: from cryptography.utils import int_from_bytes Aug 06 01:24:44.437804 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:24:44.438289 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:24:44.438586 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:24:44.438697 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:24:44.439057 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:24:44.439147 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:24:44.439226 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:24:44.439458 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:24:44.439578 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.439822 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:24:44.439909 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.440078 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:24:44.440219 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.440468 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.440552 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.440797 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.440894 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.441151 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.441252 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.441542 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.441645 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.441866 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442066 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442197 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442461 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442567 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442778 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.442861 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443103 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-1-iscsi {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443187 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443435 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443527 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443744 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.443837 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444056 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444146 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444379 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444464 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-1-iscsi {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444684 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444774 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.444997 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445111 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445330 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445415 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445652 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445829 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.445961 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.446270 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.446401 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.446577 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.446686 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.446888 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447085 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447281 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447454 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447538 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447692 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.447832 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448005 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448140 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448344 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448440 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448659 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448753 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.448972 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449091 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449324 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449480 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-1-iscsi {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449637 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449800 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.449964 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.450116 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.450279 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.450432 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.450677 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-1-iscsi {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.450846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451002 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451160 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451317 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451493 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451632 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.451782 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452046 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452139 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452361 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452455 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452674 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452771 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.452998 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453112 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453349 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453435 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453662 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453755 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.453964 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454058 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454276 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454366 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454588 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454684 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.454910 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455001 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455209 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455292 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455512 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455596 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455763 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.455846 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456072 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456162 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456397 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456494 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456708 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456789 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.456960 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.457574 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.457817 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458004 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458147 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458279 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458471 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458568 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458796 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.458890 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459049 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459194 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459301 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459508 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459623 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459820 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.459946 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460132 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460259 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460443 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460570 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460753 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.460880 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461093 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461201 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461395 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461518 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461719 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.461826 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462035 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462131 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462361 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462445 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462673 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462758 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.462996 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463089 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463349 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463439 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463638 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463722 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.463952 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464037 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464295 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464379 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464589 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464672 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464899 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.464992 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465244 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465337 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465569 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465659 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465877 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.465961 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466182 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466274 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466496 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466593 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466811 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.466935 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467120 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467215 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467431 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467539 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467680 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.467791 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468045 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468129 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468276 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468369 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468596 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468687 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468894 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.468985 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469225 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469325 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469535 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469621 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469837 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.469968 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470143 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470236 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470451 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470534 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470752 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.470835 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471056 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471147 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471365 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471459 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471671 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471754 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.471976 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.472060 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.472280 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.472362 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.472583 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.473310 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.473522 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.473616 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.473788 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.473880 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474096 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474181 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474417 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474508 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474727 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.474825 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475035 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475130 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475344 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475436 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475649 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475733 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.475955 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.476038 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.476276 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.476360 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.476583 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.476687 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477160 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477254 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477485 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477571 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477795 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.477886 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478103 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478199 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478424 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478512 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478725 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.478808 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479033 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479126 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479351 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479436 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479658 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479741 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.479963 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480099 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480271 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480392 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480583 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480677 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480884 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.480976 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481212 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481298 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481518 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481603 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481821 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.481918 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482120 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482202 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482423 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482505 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482729 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.482821 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483029 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483338 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483427 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483649 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483734 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.483955 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.484043 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.484264 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.484350 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.484571 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.484656 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.484891 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:24:44.484974 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.485256 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.485341 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.485589 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.485675 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.485923 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486006 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486239 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486329 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486551 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486690 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486868 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.486954 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487196 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487289 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487508 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487597 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487817 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.487899 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.488132 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.488238 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.488475 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.488573 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.488815 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489007 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489139 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489221 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489438 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489542 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489761 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.489846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490083 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490189 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490399 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490494 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490716 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.490799 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491040 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491138 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491360 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491444 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491675 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.491760 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492005 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492089 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492328 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492412 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492642 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492726 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.492965 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493077 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493310 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493406 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493630 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493714 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.493942 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494028 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494254 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494348 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494567 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494650 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494880 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.494967 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495192 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495600 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495823 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.495920 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496137 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496292 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496448 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496541 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496760 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.496845 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497090 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497177 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497408 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497722 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.497806 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498036 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498134 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498351 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498456 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498668 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498753 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.498982 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499066 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499295 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499420 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499608 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499700 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.499915 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500008 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500222 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500307 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500525 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500609 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500831 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.500913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501156 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501245 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501469 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501552 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501783 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.501867 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502090 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502176 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502413 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502499 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502715 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.502798 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503027 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503113 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503339 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503424 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503654 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503750 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.503996 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504208 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504296 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504428 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504610 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504704 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.504917 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505002 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505259 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505346 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505571 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505669 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505877 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.505959 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506200 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506284 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506508 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506601 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506812 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.506941 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507128 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507211 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507431 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507516 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507741 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.507836 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508053 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508144 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508371 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508493 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508687 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.508785 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509000 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509114 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509340 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509434 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509666 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509750 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.509984 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510076 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510289 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510373 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510616 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510702 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.510944 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511042 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511256 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511339 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511562 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511672 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511872 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.511976 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512176 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512269 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512483 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512584 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512788 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.512889 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513114 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513206 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513419 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513509 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513723 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.513823 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514026 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514116 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514328 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514434 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514630 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514712 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.514934 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515016 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515239 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515324 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515543 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515636 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.515930 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516152 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516236 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516456 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516541 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516764 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.516850 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517086 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517172 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517436 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517523 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517744 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.517828 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518089 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518180 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518404 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518556 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518722 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.518807 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.519034 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.519132 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.519348 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.519434 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.520180 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.520308 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.520510 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.520891 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.520979 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521247 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521334 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521565 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521660 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521893 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.521987 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522205 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522296 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522528 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522621 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522842 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.522926 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523165 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523256 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523473 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523566 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523794 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.523878 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524099 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524182 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524417 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524510 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524759 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.524843 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525118 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525221 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525445 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525539 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525771 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.525856 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526082 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526172 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526397 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526490 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526707 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.526791 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527016 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527330 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527415 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527639 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527721 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.527957 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528039 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528268 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528354 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528588 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528670 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528897 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.528984 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529244 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529341 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529550 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529635 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529865 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.529949 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530169 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530253 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530484 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530567 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530811 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.530978 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531123 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531207 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531442 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531526 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531752 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.531848 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532061 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532154 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532371 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532455 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532676 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532767 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.532982 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533112 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533315 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533399 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533625 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533721 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.533936 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534020 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534243 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534327 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534551 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534638 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534861 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.534944 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.535214 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.535782 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536008 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536200 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536315 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536522 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536628 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536835 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.536953 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537179 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537290 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537501 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537616 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537828 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.537928 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538144 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538236 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538471 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538563 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538799 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.538891 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539109 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539193 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539417 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539502 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539721 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.539812 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540027 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540118 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540338 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540421 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540647 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540733 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.540954 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541038 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541294 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541388 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541620 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541713 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.541932 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542023 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542246 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542329 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542558 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542644 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542869 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.542961 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543183 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543274 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543496 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543581 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543807 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.543898 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544127 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544220 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544441 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544523 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544750 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.544841 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545077 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545176 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545397 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545488 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545708 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.545792 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546021 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546112 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546332 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546415 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546641 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546731 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.546952 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547037 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547267 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547350 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547576 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547834 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.547927 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.548173 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.548257 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.548494 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.548748 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.548831 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549102 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549189 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549426 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549749 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.549849 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550074 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550165 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550397 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550487 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550731 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.550825 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.551196 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.551341 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.551509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.551772 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.551870 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552096 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552190 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552411 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552503 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552719 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.552803 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553025 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553148 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553363 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553459 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553671 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553755 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.553980 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554063 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554282 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554366 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554589 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554673 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554894 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.554976 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555196 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555280 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555502 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555585 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555805 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.555895 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556120 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556205 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556428 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556519 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556731 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.556815 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557038 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557140 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557388 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557471 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557702 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.557797 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558010 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558096 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558318 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558402 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558628 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558725 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.558976 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559107 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559285 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559370 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559618 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559711 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.559947 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560040 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560253 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560338 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560558 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560644 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560861 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.560951 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561200 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561288 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561512 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561599 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561818 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.561902 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562121 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562212 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562429 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562515 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562739 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.562821 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563045 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563129 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563346 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563430 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563655 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563740 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.563964 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564061 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564271 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564354 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564576 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564661 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564875 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.564967 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565201 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565288 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565514 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565598 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565823 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.565916 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566125 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566208 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566479 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566572 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566788 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.566903 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567103 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567196 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567405 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567536 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567708 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.567794 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568009 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568131 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568319 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568412 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568622 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568713 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.568923 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569014 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569258 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569356 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569569 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569654 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569872 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.569956 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570180 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570263 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570490 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570576 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570794 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.570878 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571098 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571191 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571401 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571484 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571718 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.571802 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572025 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572326 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572410 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572636 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572719 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.572937 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573028 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573266 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573367 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573571 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573656 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573879 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.573972 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574186 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574270 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574488 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574571 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574790 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.574875 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575091 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575176 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575393 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575484 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575695 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.575779 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576001 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576085 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576302 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576385 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576603 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576687 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576903 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.576993 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577250 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577335 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577559 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577691 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577863 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.577948 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578167 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578264 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578506 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578591 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578827 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.578918 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579139 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579231 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579452 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579536 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579766 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.579850 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580069 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580166 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580387 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580529 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580699 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.580798 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581012 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581173 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581338 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581423 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581642 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581727 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.581959 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.582548 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.582787 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.582861 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583095 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583169 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583403 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583488 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583728 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.583811 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584044 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584128 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584348 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584433 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584665 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584748 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.584978 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585091 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585313 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585411 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585624 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585709 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.585935 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586018 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586245 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586330 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586552 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586635 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586861 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.586953 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587171 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587481 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587573 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587790 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.587882 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588101 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588184 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588411 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588494 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588717 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.588810 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589023 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589213 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589361 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589447 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589664 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589757 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.589980 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590065 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590276 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590358 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590593 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590715 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590897 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.590996 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591210 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591322 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591519 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591636 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591834 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.591949 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592145 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592259 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592572 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592658 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592883 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.592974 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593227 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593325 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593534 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593618 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593836 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.593919 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594148 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594240 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594467 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594553 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594801 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.594886 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595194 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595461 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595546 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595767 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.595857 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596082 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596182 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596409 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596494 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596712 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.596802 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.597016 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.597138 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.597350 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.597443 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598220 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598314 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598542 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598618 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598872 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.598954 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.599181 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.599373 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.599512 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.599694 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.599821 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600004 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600146 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600424 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600573 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600740 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.600895 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.601069 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.601233 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.601406 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.601658 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.601745 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602236 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602325 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602552 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602645 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602882 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.602973 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603200 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603303 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603526 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603611 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603836 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.603934 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604153 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604245 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604464 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604561 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604772 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.604870 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605126 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605230 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605445 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605568 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605763 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.605857 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606070 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606162 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606395 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606480 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606721 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.606818 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607039 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607131 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607365 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607450 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607730 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.607826 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608042 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608128 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608349 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608443 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608664 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608757 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.608974 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609089 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609308 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609393 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609632 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609718 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.609938 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610029 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610244 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610327 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610554 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610651 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610863 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.610957 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611170 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611263 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611476 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611561 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611787 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.611876 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612092 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612186 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612398 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612482 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612704 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.612788 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613029 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613150 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613399 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613515 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613729 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.613947 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614083 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614412 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614599 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614739 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.614909 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615046 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615217 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615371 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615526 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615682 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615873 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.615990 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616182 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616297 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616507 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616592 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616841 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.616934 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617204 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617305 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617522 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617608 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617860 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.617954 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618190 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618282 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618502 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618585 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618819 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.618904 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619151 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619237 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619463 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619547 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619773 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.619858 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620087 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620179 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620394 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620484 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620701 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.620827 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621006 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621104 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621344 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621428 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621650 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621735 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.621955 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622046 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622264 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622361 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622567 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622652 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622877 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.622961 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623183 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623502 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623808 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.623899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624116 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624208 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624427 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624514 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624735 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.624820 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625195 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625378 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625472 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625705 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.625844 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626019 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626114 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626339 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626424 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626650 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626745 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.626968 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627060 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627286 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627371 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627601 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627686 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.627918 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628011 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628233 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628327 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628543 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628627 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.628858 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629034 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629236 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629322 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629549 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629695 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.629871 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.630192 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.630283 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.630513 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.630598 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.630852 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631032 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631171 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631364 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631488 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631682 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631807 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.631997 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632125 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632319 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632443 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632637 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632758 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.632954 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633093 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633296 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633412 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633611 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633746 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.633924 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634069 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634237 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634397 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634567 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634744 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.634891 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635065 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635218 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635384 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635558 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635701 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.635879 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636018 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636197 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636378 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636516 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636696 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.636833 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637007 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637216 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637346 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637663 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637844 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.637979 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638162 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638481 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638606 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638798 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.638920 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639114 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639235 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639432 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639548 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639748 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.639845 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640063 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640158 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640378 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640471 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640692 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.640853 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641009 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641124 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641350 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641436 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641679 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.641781 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642018 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642104 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642340 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642424 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642657 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642861 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.642959 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.643178 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.643264 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.643513 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.643784 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.643870 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.644101 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.644193 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.644439 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.645085 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.645459 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.645553 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.645749 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.645834 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646073 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646166 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646397 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646484 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646732 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.646817 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647044 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647140 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647349 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647433 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647665 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647751 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.647975 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648071 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648279 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648363 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648600 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648684 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.648912 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649007 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649243 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649483 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649568 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649828 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.649924 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.650145 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.650386 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.650479 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.650732 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.650818 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651051 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651137 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651378 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651487 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651703 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.651787 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652014 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652100 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652320 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652403 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652637 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652720 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.652949 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653034 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653280 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653367 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653588 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653674 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653898 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.653990 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654208 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654302 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654601 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654818 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.654910 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655126 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655212 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655428 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655521 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655740 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.655825 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656044 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656128 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656350 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656447 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656662 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656747 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.656966 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657082 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657292 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657390 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657600 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657685 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.657987 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658210 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658298 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658509 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658600 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658812 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.658902 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659113 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659198 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659414 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659505 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659718 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.659802 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.660019 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.660718 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.660881 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.660969 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.661240 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.661330 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.661602 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.661688 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.661957 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662041 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662375 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662584 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662667 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662908 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.662991 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663222 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663315 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663537 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663668 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663862 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.663946 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.664176 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.664271 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.664491 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.664714 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.664838 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.665068 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.665182 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.665400 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.665722 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.665815 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666053 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666138 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666363 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666455 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666671 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666757 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.666980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667070 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667304 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667391 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667610 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667693 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.667919 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668004 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668241 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668340 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668543 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668628 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668853 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.668945 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669191 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669334 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669506 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669591 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669819 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.669918 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670125 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670259 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670435 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670528 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670744 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.670837 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671051 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671136 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671359 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671444 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671667 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671762 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.671977 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672060 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672289 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672374 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672602 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672688 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.672925 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673011 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673267 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673353 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673588 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673675 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673901 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.673993 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674211 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674296 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674522 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674609 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674832 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.674915 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675144 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675236 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675455 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675542 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675795 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.675896 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676103 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676266 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676519 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676604 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676833 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.676917 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677183 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677284 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677508 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677632 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677818 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.677948 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678141 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678270 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678465 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678598 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678780 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.678912 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679102 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679296 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679427 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679640 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679726 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.679958 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680063 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680282 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680364 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680596 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680696 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.680928 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681015 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681291 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681376 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681598 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681681 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681908 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.681996 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682225 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682322 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682529 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682612 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682830 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.682921 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683132 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683216 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683534 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683746 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.683884 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684049 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684133 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684348 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684446 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684651 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684736 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.684953 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685092 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685282 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685379 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685584 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685670 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685886 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.685969 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686186 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686278 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686487 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686572 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686789 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.686872 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687094 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687185 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687395 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687479 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687696 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687780 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.687996 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688081 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688300 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688384 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688602 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688692 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688908 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.688995 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689238 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689324 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689545 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689639 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689848 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.689941 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690179 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690266 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690505 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690610 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690816 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.690901 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691139 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691231 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691480 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691582 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691807 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.691966 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692140 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692228 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692430 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692525 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692755 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.692840 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693096 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693197 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693413 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693507 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693743 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.693827 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694061 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694155 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694372 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694458 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694683 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694766 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.694997 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695089 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695309 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695397 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695621 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695705 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.695945 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696030 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696269 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696356 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696576 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696660 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696888 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.696980 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697245 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697332 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697560 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697645 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697873 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.697970 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698186 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698497 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698580 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698809 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.698902 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699122 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699214 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699433 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699525 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699742 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.699827 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700053 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700138 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700367 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700450 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700666 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700754 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.700979 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701099 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701324 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701412 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701642 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701728 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.701966 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702057 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702292 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702389 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702607 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702693 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.702942 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703027 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703277 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703370 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703597 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703681 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.703996 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.704219 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.704313 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.704465 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:24:44.704579 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.704897 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.705246 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.705556 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:24:44.705802 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:24:44.858247 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Registered counter for database nova_api Aug 06 01:24:44.860683 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO dbcounter [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Registered counter for database nova_api Aug 06 01:24:44.880461 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.882545 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.887180 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:44.888953 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writer thread running {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:44.943862 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.context [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63b0eb87-9452-4c97-8ca1-d697fc2186af(cell1) {{(pid=103207) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 01:24:44.944045 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.context [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63b0eb87-9452-4c97-8ca1-d697fc2186af(cell1) {{(pid=103206) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 01:24:44.947763 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:24:44.947898 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:24:44.948241 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:24:44.948333 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:24:44.949824 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:24:44.949917 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:24:44.950554 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:24:44.950645 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:24:44.950998 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:24:44.951101 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:24:44.952955 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:24:44.953088 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:24:44.954944 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO dbcounter [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Registered counter for database nova_cell0 Aug 06 01:24:44.955040 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Registered counter for database nova_cell0 Aug 06 01:24:44.960945 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO dbcounter [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Registered counter for database nova_cell1 Aug 06 01:24:44.961132 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Registered counter for database nova_cell1 Aug 06 01:24:44.968143 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.970051 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.973354 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.974744 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:44.975133 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writer thread running {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:44.982485 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:44.982828 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:45.112653 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writer thread running {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:45.122599 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO dbcounter [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Registered counter for database nova_cell0 Aug 06 01:24:45.126951 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Registered counter for database nova_cell0 Aug 06 01:24:45.131837 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:45.135484 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:24:45.137073 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writer thread running {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:45.140141 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:24:45.476430 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:24:45.477291 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:24:45.483897 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:24:45.484100 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:24:45.826613 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:24:45.827205 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:24:45.832827 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:24:45.833193 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:24:45.838147 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555742b019c0 pid: 103206 (default app) Aug 06 01:24:45.838408 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555742b019c0 pid: 103207 (default app) Aug 06 01:24:45.840219 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:24:45.841415 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b3c65c41-7962-40a5-830d-4041814d3219 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Aug 06 01:24:45.841813 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Aug 6 01:24:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:01.509655 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:01.511653 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002801 Aug 06 01:26:01.512609 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:01.528945 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_api:SELECT=3 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:01.530103 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_cell0:SELECT=3 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:01.530956 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_cell1:SELECT=3 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:01.532161 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:02.377988 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-2c23c13d-0473-49a3-b7fa-4b328fe6a717 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:02.412656 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-2c23c13d-0473-49a3-b7fa-4b328fe6a717 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893661 Aug 06 01:26:02.413878 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Aug 6 01:26:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:04.626567 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:04.628080 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-1d145f49-7b4b-4d62-873f-ffa309fe5b01 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 Aug 06 01:26:04.628641 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:26:05.093453 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-090de68c-ff0e-4077-9937-53969defa3ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "disk": 1, "id": "c1"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:05.114902 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:26:05.114902 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: warnings.warn(msg) Aug 06 01:26:05.142444 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-090de68c-ff0e-4077-9937-53969defa3ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506743 Aug 06 01:26:05.143164 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:05.157260 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.158196 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell1:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.159253 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell0:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.160097 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.365624 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-1cf4cf14-4cfc-466e-b185-13b263387435 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:05.369983 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:26:05.369983 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:26:05.443399 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-1cf4cf14-4cfc-466e-b185-13b263387435 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291610 Aug 06 01:26:05.447882 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Aug 6 01:26:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:26:07.690498 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-090de68c-ff0e-4077-9937-53969defa3ea admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:07.691519 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-090de68c-ff0e-4077-9937-53969defa3ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 06 01:26:07.691947 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:08.348191 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-68a86ab5-49d8-483f-992d-1ab7bd84f229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:08.367840 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:26:08.367840 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:26:08.388622 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-68a86ab5-49d8-483f-992d-1ab7bd84f229 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.690394 Aug 06 01:26:08.389198 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:08.402473 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-ee437884-e1be-430d-8d19-b69ff775e2c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:08.405526 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:26:08.405526 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: warnings.warn(msg) Aug 06 01:26:08.441139 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-ee437884-e1be-430d-8d19-b69ff775e2c8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042330 Aug 06 01:26:08.442134 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Aug 6 01:26:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:26:10.693336 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-68a86ab5-49d8-483f-992d-1ab7bd84f229 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:10.694436 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-68a86ab5-49d8-483f-992d-1ab7bd84f229 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 06 01:26:10.704731 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:11.051502 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-33712538-62f8-4374-97c7-caab7bc4c2bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "disk": 10}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:11.070917 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-33712538-62f8-4374-97c7-caab7bc4c2bc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.370352 Aug 06 01:26:11.071472 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:11.083841 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c25dc85d-179b-43fa-9671-45107b1c8c09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:11.107870 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-c25dc85d-179b-43fa-9671-45107b1c8c09 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028206 Aug 06 01:26:11.108452 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Aug 6 01:26:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:13.326122 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-33712538-62f8-4374-97c7-caab7bc4c2bc admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:13.327069 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-33712538-62f8-4374-97c7-caab7bc4c2bc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 06 01:26:13.327487 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:13.758674 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-457ce449-35c8-4064-a9fb-a70d10e80f75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:13.777534 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-457ce449-35c8-4064-a9fb-a70d10e80f75 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444268 Aug 06 01:26:13.778248 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 01:26:13.790780 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-718effc1-0a51-4f94-8d38-5ccbc2e69ebd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:13.814242 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-718effc1-0a51-4f94-8d38-5ccbc2e69ebd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027143 Aug 06 01:26:13.815098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Aug 6 01:26:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:16.034976 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-457ce449-35c8-4064-a9fb-a70d10e80f75 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:16.036546 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-457ce449-35c8-4064-a9fb-a70d10e80f75 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 06 01:26:16.037022 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:16.483523 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:16.502776 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459667 Aug 06 01:26:16.503478 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 01:26:16.516828 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-40a18d5b-fc61-4b0e-a212-9d38660563d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:16.541658 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-40a18d5b-fc61-4b0e-a212-9d38660563d5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028472 Aug 06 01:26:16.542314 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Aug 6 01:26:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:18.765102 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:18.766135 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 06 01:26:18.766533 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:19.212969 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-5ced4e00-9c27-4ea6-98bb-36378a0a2df8 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:19.239607 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-5ced4e00-9c27-4ea6-98bb-36378a0a2df8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465720 Aug 06 01:26:19.240323 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Aug 6 01:26:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:21.459882 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:21.460907 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-9c4b074e-4bbd-4233-9b32-986f3e845ae4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 06 01:26:21.461347 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:21.914993 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-82ff0b3e-aefc-4fb8-8003-793ce8cd1b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "disk": 1, "id": "1"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:21.934818 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-82ff0b3e-aefc-4fb8-8003-793ce8cd1b75 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467286 Aug 06 01:26:21.935376 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 01:26:21.947538 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8e5f2275-7952-421c-8cd2-221d46689863 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:21.979407 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-8e5f2275-7952-421c-8cd2-221d46689863 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035011 Aug 06 01:26:21.980361 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Aug 6 01:26:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:24.357824 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-82ff0b3e-aefc-4fb8-8003-793ce8cd1b75 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:24.358854 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-82ff0b3e-aefc-4fb8-8003-793ce8cd1b75 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 06 01:26:24.359256 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:24.757550 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-29fae036-5e78-43bf-ba8f-d5fb0eda183d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:24.776994 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-29fae036-5e78-43bf-ba8f-d5fb0eda183d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410971 Aug 06 01:26:24.777520 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:24.790414 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-738cc94b-5dcc-46a2-91d4-1bc28a9eeaf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:24.814998 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-738cc94b-5dcc-46a2-91d4-1bc28a9eeaf8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029060 Aug 06 01:26:24.815742 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Aug 6 01:26:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:26:27.018617 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-29fae036-5e78-43bf-ba8f-d5fb0eda183d admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:27.019667 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-29fae036-5e78-43bf-ba8f-d5fb0eda183d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 06 01:26:27.020699 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:27.436964 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-6b1a01b7-7463-45cf-a3b4-3558e78371db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "ram": 4096, "disk": 40, "rxtx_factor": 1.0}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:27.456443 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-6b1a01b7-7463-45cf-a3b4-3558e78371db admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.429061 Aug 06 01:26:27.462552 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:27.469832 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-2d609a92-5489-41ec-8c71-f54c57fc131b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:27.495885 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-2d609a92-5489-41ec-8c71-f54c57fc131b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029990 Aug 06 01:26:27.496626 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Aug 6 01:26:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:29.743775 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-6b1a01b7-7463-45cf-a3b4-3558e78371db admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:29.744982 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-6b1a01b7-7463-45cf-a3b4-3558e78371db admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 06 01:26:29.745425 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:30.275462 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-e3d44af3-85b4-4c2f-8359-b76523a360e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:30.295320 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-e3d44af3-85b4-4c2f-8359-b76523a360e3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.543174 Aug 06 01:26:30.295870 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:26:30.309646 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-1023ad1d-52f6-4f40-8353-0574e83c7e45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:30.333992 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-1023ad1d-52f6-4f40-8353-0574e83c7e45 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029100 Aug 06 01:26:30.334583 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Aug 6 01:26:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:26:32.559784 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-e3d44af3-85b4-4c2f-8359-b76523a360e3 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:32.560804 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-e3d44af3-85b4-4c2f-8359-b76523a360e3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 06 01:26:32.561448 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:33.000412 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "swap": 0, "ram": 16384}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:33.023649 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455268 Aug 06 01:26:33.024204 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Aug 6 01:26:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 01:26:33.036682 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-238f8397-8686-46ea-8e3f-f378946db8a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:26:33.042608 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:33.063375 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-238f8397-8686-46ea-8e3f-f378946db8a8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030778 Aug 06 01:26:33.064484 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Aug 6 01:26:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:26:53.787394 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:53.788386 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 06 01:26:53.788787 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:54.175925 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-eb9c91e2-f92b-4147-8310-3064f9d67359 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:54.194928 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-eb9c91e2-f92b-4147-8310-3064f9d67359 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400087 Aug 06 01:26:54.195468 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Aug 6 01:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:26:55.283501 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:55.285571 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-e8476131-d6b6-4b42-9625-e4ba01f3ceef admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 Aug 06 01:26:55.287792 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:26:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:55.870638 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-66da1dba-8220-41cb-ba72-cb4dda87a060 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:55.876262 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-66da1dba-8220-41cb-ba72-cb4dda87a060 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-66da1dba-8220-41cb-ba72-cb4dda87a060 admin admin] Request method failure captured: Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept: application/json Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Connection: keep-alive Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Content-Length: 0 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Host: 10.222.0.26 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABi7cNfNs0dXgSXyKHZkQhG0niXzP5f0Ex3hG-10YFR4xVoONSzSGTsTNts0NHZ07JhrrC83R4lDFcJPcDbQxdEsIV_ZOrMaOFSZWUrPq8rMCu7i4ZxHZkInaB--cCSpzzxr0gEfoBZvSkfis159KY3z2uEqfk6cFzANOkJY_Gvd-U9wjY Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Id: None Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Name: None Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Name: admin Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Role: member,reader,admin Aug 06 01:26:55.879535 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Roles: member,reader,admin Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant: admin Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User: admin Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Name: admin Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: method: > Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: exception: Flavor 42 could not be found. Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: action_args: {'id': '42'} Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:55.881165 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:55.882093 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.883295 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-66da1dba-8220-41cb-ba72-cb4dda87a060 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:55.884338 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-66da1dba-8220-41cb-ba72-cb4dda87a060 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.449039 Aug 06 01:26:55.884338 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Aug 6 01:26:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:55.891896 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-71e42ecc-e6aa-4de0-af6e-c230309ad159 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:55.897865 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:55.917569 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-71e42ecc-e6aa-4de0-af6e-c230309ad159 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030024 Aug 06 01:26:55.918072 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:55.928931 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-dcaf864a-6a5f-466e-9630-ff6b9c545d74 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:55.952863 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-dcaf864a-6a5f-466e-9630-ff6b9c545d74 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028350 Aug 06 01:26:55.953438 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:55.963560 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7242402b-fb2b-4402-a5a0-a506583c3455 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:55.969715 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-7242402b-fb2b-4402-a5a0-a506583c3455 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7242402b-fb2b-4402-a5a0-a506583c3455 admin admin] Request method failure captured: Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept: application/json Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Connection: keep-alive Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Content-Length: 0 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Host: 10.222.0.26 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi7cNfNs0dXgSXyKHZkQhG0niXzP5f0Ex3hG-10YFR4xVoONSzSGTsTNts0NHZ07JhrrC83R4lDFcJPcDbQxdEsIV_ZOrMaOFSZWUrPq8rMCu7i4ZxHZkInaB--cCSpzzxr0gEfoBZvSkfis159KY3z2uEqfk6cFzANOkJY_Gvd-U9wjY Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Role: member,reader,admin Aug 06 01:26:55.973013 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Roles: member,reader,admin Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant: admin Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User: admin Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Name: admin Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: method: > Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: exception: Flavor 42 could not be found. Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: action_args: {'id': '42'} Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:55.975255 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:55.976293 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:55.977706 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7242402b-fb2b-4402-a5a0-a506583c3455 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:55.978924 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-7242402b-fb2b-4402-a5a0-a506583c3455 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015064 Aug 06 01:26:55.978924 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Aug 6 01:26:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:56.942837 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-dcaf864a-6a5f-466e-9630-ff6b9c545d74 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:56.943889 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-dcaf864a-6a5f-466e-9630-ff6b9c545d74 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 06 01:26:56.944288 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:57.466391 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-93d02b9f-bfca-4d0f-b033-554484e68ca4 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:57.471745 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-93d02b9f-bfca-4d0f-b033-554484e68ca4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-93d02b9f-bfca-4d0f-b033-554484e68ca4 admin admin] Request method failure captured: Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept: application/json Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Connection: keep-alive Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Content-Length: 0 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Host: 10.222.0.26 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi7cNga5hf3jz7g9TyrLQMaU3ZQqM5drobc-kx5oM4J6ep-WCZREinUz8rtJNY8XVkHKahLuZTXULwOXJBYl0WxXG_gq_u2lbuZejFgeI633_xW1GwlPiZkEHqbZLtTQNe4E5r8Ae0jFuzCiCyWik0LUDTSuSDBkicRscVKcJUsV4c9PU Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Role: member,reader,admin Aug 06 01:26:57.473846 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Roles: member,reader,admin Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant: admin Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User: admin Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Name: admin Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: method: > Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: exception: Flavor 84 could not be found. Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: action_args: {'id': '84'} Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:57.475121 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:57.475899 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.477122 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-93d02b9f-bfca-4d0f-b033-554484e68ca4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:57.478271 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-93d02b9f-bfca-4d0f-b033-554484e68ca4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392512 Aug 06 01:26:57.478271 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Aug 6 01:26:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:57.485333 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-c8cc7e90-87dd-4e0b-b605-2dfcbcb3391f admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:57.500322 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-c8cc7e90-87dd-4e0b-b605-2dfcbcb3391f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018581 Aug 06 01:26:57.500850 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:57.510400 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7bcc294a-066f-43ad-94c9-0de1493050bb admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:57.527310 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-7bcc294a-066f-43ad-94c9-0de1493050bb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020364 Aug 06 01:26:57.527856 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:57.537923 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ddbc9e0-3998-4a78-8c54-d1034ae59273 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:57.543213 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-8ddbc9e0-3998-4a78-8c54-d1034ae59273 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ddbc9e0-3998-4a78-8c54-d1034ae59273 admin admin] Request method failure captured: Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept: application/json Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Connection: keep-alive Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Content-Length: 0 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Host: 10.222.0.26 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABi7cNga5hf3jz7g9TyrLQMaU3ZQqM5drobc-kx5oM4J6ep-WCZREinUz8rtJNY8XVkHKahLuZTXULwOXJBYl0WxXG_gq_u2lbuZejFgeI633_xW1GwlPiZkEHqbZLtTQNe4E5r8Ae0jFuzCiCyWik0LUDTSuSDBkicRscVKcJUsV4c9PU Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Id: None Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Name: None Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Name: admin Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Role: member,reader,admin Aug 06 01:26:57.544696 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Roles: member,reader,admin Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant: admin Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User: admin Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Name: admin Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: method: > Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: exception: Flavor 84 could not be found. Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: action_args: {'id': '84'} Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:57.546260 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:57.547098 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:57.548150 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ddbc9e0-3998-4a78-8c54-d1034ae59273 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:57.549408 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-8ddbc9e0-3998-4a78-8c54-d1034ae59273 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012417 Aug 06 01:26:57.549408 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Aug 6 01:26:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:58.511608 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7bcc294a-066f-43ad-94c9-0de1493050bb admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:58.512617 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-7bcc294a-066f-43ad-94c9-0de1493050bb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 06 01:26:58.513015 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:26:59.030134 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b65ed7f0-42c5-4bd2-ad47-74321621a3bd admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:59.036381 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-b65ed7f0-42c5-4bd2-ad47-74321621a3bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b65ed7f0-42c5-4bd2-ad47-74321621a3bd admin admin] Request method failure captured: Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept: application/json Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Connection: keep-alive Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Content-Length: 0 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Host: 10.222.0.26 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABi7cNivDnVV0jG5R0U4r1NPiWtNOMXpy85y5iX5lKw3OPdJ5B25VYzNnoHofXsQPbD4tnYqDaZI_nckfL4ho3wLGiACtGGb1AZUV2weorzDAS1_UpzBRM-9HSChO092Fz6yyWi3q5zm5UDxFf199dfr9Agtlkio1bffPbiwwTwFhtRwXg Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Id: None Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Domain-Name: None Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Project-Name: admin Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Role: member,reader,admin Aug 06 01:26:59.037905 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Roles: member,reader,admin Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant: admin Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User: admin Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: X-User-Name: admin Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: method: > Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: exception: Flavor 451 could not be found. Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: action_args: {'id': '451'} Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:59.039586 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:59.040634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.041986 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b65ed7f0-42c5-4bd2-ad47-74321621a3bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:59.043357 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b65ed7f0-42c5-4bd2-ad47-74321621a3bd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389935 Aug 06 01:26:59.043357 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:26:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:59.048997 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-149313d0-f824-4fa9-a6d3-6a8aa49f9f20 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:59.064580 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-149313d0-f824-4fa9-a6d3-6a8aa49f9f20 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019131 Aug 06 01:26:59.065124 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:59.074627 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:59.089692 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018593 Aug 06 01:26:59.090237 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Aug 6 01:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:26:59.099953 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-588b9c8a-1141-4f7a-91fc-f7b855ad2a31 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:26:59.105953 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-588b9c8a-1141-4f7a-91fc-f7b855ad2a31 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-588b9c8a-1141-4f7a-91fc-f7b855ad2a31 admin admin] Request method failure captured: Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept: application/json Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Connection: keep-alive Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Content-Length: 0 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Host: 10.222.0.26 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi7cNivDnVV0jG5R0U4r1NPiWtNOMXpy85y5iX5lKw3OPdJ5B25VYzNnoHofXsQPbD4tnYqDaZI_nckfL4ho3wLGiACtGGb1AZUV2weorzDAS1_UpzBRM-9HSChO092Fz6yyWi3q5zm5UDxFf199dfr9Agtlkio1bffPbiwwTwFhtRwXg Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Role: member,reader,admin Aug 06 01:26:59.107441 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Roles: member,reader,admin Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/477e329599354f58af86e800a455a8b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_477e329599354f58af86e800a455a8b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/477e329599354f58af86e800a455a8b2"}]}] Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant: admin Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Id: 477e329599354f58af86e800a455a8b2 Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User: admin Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Id: ca5d3774b93a41d1a8b95796b7899d4c Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: X-User-Name: admin Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: method: > Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: exception: Flavor 451 could not be found. Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: action_args: {'id': '451'} Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:26:59.108980 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:59.109913 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Aug 06 01:26:59.111199 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-588b9c8a-1141-4f7a-91fc-f7b855ad2a31 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:26:59.112437 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-588b9c8a-1141-4f7a-91fc-f7b855ad2a31 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012948 Aug 06 01:26:59.112437 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:26:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 01:27:00.080711 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:00.081765 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 06 01:27:00.082161 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:27:00.606649 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-aa3189ce-be81-444c-888e-22bf9c5f3297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:27:00.625149 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-aa3189ce-be81-444c-888e-22bf9c5f3297 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401101 Aug 06 01:27:00.625681 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Aug 6 01:27:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:27:01.591539 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:01.592545 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 06 01:27:01.592935 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:27:02.125530 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-b56633fe-2694-426e-9f41-4d36056b3fbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:27:02.143344 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-b56633fe-2694-426e-9f41-4d36056b3fbb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.407509 Aug 06 01:27:02.143877 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Aug 6 01:27:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:27:03.110196 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:03.111281 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 06 01:27:03.111682 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:27:03.634033 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-27e5bb15-adc8-4e1d-b5d1-09e36d7b5692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:27:03.653513 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-27e5bb15-adc8-4e1d-b5d1-09e36d7b5692 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403513 Aug 06 01:27:03.654052 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Aug 6 01:27:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:27:04.615579 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:04.616634 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 06 01:27:04.617036 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:27:05.140217 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-04f94766-5cac-4c62-a579-399a326126bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:27:05.159134 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-04f94766-5cac-4c62-a579-399a326126bb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400588 Aug 06 01:27:05.159684 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Aug 6 01:27:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:27:06.140880 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:06.142004 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 06 01:27:06.142409 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:27:06.661231 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-a32c8a8d-81b2-4d42-84f2-d04dfe178190 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:06.682182 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-a32c8a8d-81b2-4d42-84f2-d04dfe178190 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402410 Aug 06 01:27:06.682718 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Aug 6 01:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:27:57.743564 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:57.744574 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-adfa430d-397e-4790-a393-9befda781b5e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 06 01:27:57.744972 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Aug 6 01:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:27:57.756142 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:58.143543 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-30aa299c-36a1-4444-bee5-38d1e34b02b1 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:58.165307 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-30aa299c-36a1-4444-bee5-38d1e34b02b1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414375 Aug 06 01:27:58.165854 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Aug 6 01:27:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:27:58.188892 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-4cae543f-0278-45a9-b91c-d5042ea46e1d admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:58.192485 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG dbcounter [-] [103206] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:58.198442 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-4cae543f-0278-45a9-b91c-d5042ea46e1d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013180 Aug 06 01:27:58.198968 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Aug 6 01:27:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:27:58.210910 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-7cb7bc17-ae25-4784-ad87-60acc6786bfa admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:58.218497 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-7cb7bc17-ae25-4784-ad87-60acc6786bfa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011689 Aug 06 01:27:58.219006 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Aug 6 01:27:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:27:58.231305 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:58.239409 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011909 Aug 06 01:27:58.239941 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Aug 6 01:27:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:27:58.251081 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-70b4728d-0ed6-45e8-9a78-923fe336f624 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:27:58.258586 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-70b4728d-0ed6-45e8-9a78-923fe336f624 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010990 Aug 06 01:27:58.259099 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Aug 6 01:27:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:30:49.093950 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:30:49.094960 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 06 01:30:49.095356 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:30:49.239313 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=6 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:49.397093 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:30:49.399496 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:30:49.399496 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:30:49.400624 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:30:49.401134 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:30:49.401570 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:30:49.402290 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:30:49.402737 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:30:49.403149 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:30:49.438040 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-a9fee2e1-3efe-49ea-9938-110e871c6b0a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200101 Aug 06 01:30:49.438614 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:30:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:30:50.270307 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:30:50.271322 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 06 01:30:50.271745 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:30:50.461584 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:30:50.463986 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:30:50.463986 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:30:50.465123 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:30:50.465608 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:30:50.466042 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:30:50.466763 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:30:50.467211 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:30:50.467633 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:30:50.487243 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-920855d7-47ca-4e65-9d4d-0565544d4231 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077994 Aug 06 01:30:50.487739 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:30:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:31:01.723057 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:31:01.724069 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 06 01:31:01.724594 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:31:01.871815 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell0:SELECT=4 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:01.872522 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell1:SELECT=4 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:01.873390 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=8 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:01.922428 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:31:01.924769 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:31:01.924769 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:31:01.925922 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:31:01.926395 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:31:01.926821 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:31:01.927724 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:31:01.928341 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:31:01.928758 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:31:01.953707 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-05bec55d-766a-441c-8d91-ffb93bfa44df admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086220 Aug 06 01:31:01.954265 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:31:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:31:02.776728 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:31:02.777790 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-37278ec6-ae7f-4b6c-b526-010f12afaad8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 06 01:31:02.778184 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Aug 6 01:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:31:02.969022 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:31:02.971418 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:31:02.971418 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Aug 06 01:31:02.972518 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:31:02.973002 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:31:02.973463 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:31:02.974203 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:31:02.975334 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:31:02.975752 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:31:02.997743 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-0d266442-eaca-4890-a3cd-2d87b85c742f admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080372 Aug 06 01:31:02.998231 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Aug 6 01:31:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:31:59.451231 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: Sat Aug 6 01:31:59 2022 - graceful shutdown triggered... Aug 06 01:31:59.451016 dv-cinder-852009-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 01:31:59.452392 dv-cinder-852009-1-iscsi devstack@n-api.service[103207]: Gracefully killing worker 2 (pid: 103207)... Aug 06 01:31:59.452849 dv-cinder-852009-1-iscsi devstack@n-api.service[103206]: Gracefully killing worker 1 (pid: 103206)... Aug 06 01:32:00.452040 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: worker 1 buried after 1 seconds Aug 06 01:32:00.452479 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: worker 2 buried after 1 seconds Aug 06 01:32:00.452479 dv-cinder-852009-1-iscsi devstack@n-api.service[103205]: goodbye to uWSGI. Aug 06 01:32:00.453662 dv-cinder-852009-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 06 01:32:00.454205 dv-cinder-852009-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 01:32:00.457030 dv-cinder-852009-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 01:32:00.468254 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 01:32:00 2022] *** Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: nodename: dv-cinder-852009-1-iscsi Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: machine: x86_64 Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: clock source: unix Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: pcre jit disabled Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: detected number of CPU cores: 4 Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: current working directory: / Aug 06 01:32:00.470506 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: detected binary path: /usr/bin/uwsgi-core Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: your processes number limit is 47680 Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: your memory page size is 4096 bytes Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: detected max file descriptor number: 2048 Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: lock engine: pthread robust mutexes Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: thunder lock: enabled Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 01:32:00.471322 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 01:32:00.514158 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: Python main interpreter initialized at 0x56303b6d09c0 Aug 06 01:32:00.514158 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: python threads support enabled Aug 06 01:32:00.514158 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: your server socket listen backlog is limited to 100 connections Aug 06 01:32:00.514158 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: your mercy for graceful operations on workers is 90 seconds Aug 06 01:32:00.514598 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 01:32:00.514598 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: *** Operational MODE: preforking *** Aug 06 01:32:00.514868 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: *** uWSGI is running in multiple interpreter mode *** Aug 06 01:32:00.514868 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: spawned uWSGI master process (pid: 124299) Aug 06 01:32:00.515078 dv-cinder-852009-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 01:32:00.515636 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: spawned uWSGI worker 1 (pid: 124313, cores: 1) Aug 06 01:32:00.516136 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: spawned uWSGI worker 2 (pid: 124314, cores: 1) Aug 06 01:32:00.516516 dv-cinder-852009-1-iscsi devstack@n-api.service[124299]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 01:32:01.180058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 01:32:01.182279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 01:32:02.338113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:32:02.338113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: from cryptography.utils import int_from_bytes Aug 06 01:32:02.338774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:32:02.338774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: from cryptography.utils import int_from_bytes Aug 06 01:32:02.345962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:32:02.345962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: from cryptography.utils import int_from_bytes Aug 06 01:32:02.346470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:32:02.346470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: from cryptography.utils import int_from_bytes Aug 06 01:32:04.671640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:32:04.672232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:32:04.672345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:32:04.672687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:32:04.672945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:32:04.673358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.673684 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.674007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.674330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.674674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.674985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.675308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-1-iscsi {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.678861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.680584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.681787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.682091 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.682415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.682887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.683306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-1-iscsi {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.683431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:32:04.683900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.684002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:32:04.684090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.684180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:32:04.684276 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.684534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:32:04.684662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.684795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:32:04.684937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.685277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.685407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.685594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.685708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.685921 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.686972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687190 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.687907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.688843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-1-iscsi {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.689931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690575 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.690984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.691135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.691386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.691487 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.692274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.692442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.692593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.692695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.692962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.693934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694459 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694766 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.694859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695077 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695391 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-1-iscsi {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.695805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.696783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697634 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.697970 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698392 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.698915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.699956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700585 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.700959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.701793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.702953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.703087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.703253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.703546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.703866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.703979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.704901 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.705834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.706789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.707014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.707999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708859 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.708950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709225 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.709987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.710896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711698 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.711833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.712937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.713259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.713381 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.713492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.713619 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.713911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.714896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.715078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.715232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.715644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.715804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.715961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.716128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.716287 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.716443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.716599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.716753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.717906 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.718989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.719143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.719342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.719501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.719501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.719800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.719962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.720116 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.720283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.720440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.720598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.720762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.720917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.721151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.721317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.721464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.721617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.721782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.721929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.722084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.722241 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.722403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.722550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.722696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.722862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.723022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.723182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.723330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.723482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.723630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.723786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.724112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.724270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.724425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.724425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.724724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.724871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.725031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.725222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.725370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.725523 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.725678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.725678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.725975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.726123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.726268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.726423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.726569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.726725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.726883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.727056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.727291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.727450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.727597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.727762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.727911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.728063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.728217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.728371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.728527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.728683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.728830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.728976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.729156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.729653 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.729816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.729976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.730205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.730365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.730519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.730667 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.730820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.730980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.731141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.731296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:32:04.731451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.731609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.731757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.731903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732207 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.732972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.733345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.733499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.733657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.733816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.733965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.734257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.734418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.734576 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.734737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.734893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.735979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736441 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.736896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.737073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.737236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.737492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738593 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.738904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.739170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.739389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.739684 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.739843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.740771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.741878 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742488 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742641 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742797 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.742952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743100 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.743881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.744036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.744337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.744501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.744659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.744861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745352 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.745962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.746878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747639 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.747900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748059 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748216 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.748984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.749213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.749371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.749567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.749726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.749886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750046 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.750949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.751976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.752888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753217 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753664 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.753979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.754907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755817 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.755970 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.756899 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.757886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758600 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.758909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.759941 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.760866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761520 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761672 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.761964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.762877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.763964 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.764112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.764264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.764418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.764565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.764725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.765871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766312 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.766928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767383 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.767995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.768160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.768401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.768566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.768715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.768861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.769007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.769198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.769345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.769508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.769719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.770413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.770573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.770728 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.770888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.771982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.772139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.772285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.772591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.772762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.772914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.773861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.774916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775808 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.775962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.776873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.777980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.778128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.778299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.778552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.778719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.778905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.779904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780373 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.780986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.781927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.782860 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783469 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.783927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784687 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.784996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.785402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.785692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.785927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786535 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.786856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787163 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.787805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788019 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.788912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.789923 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.790998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.791904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.792989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.793203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.793371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.793536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.793690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.793843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794003 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794003 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794798 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.794952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.795123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.796905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797561 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.797880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.798949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799589 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.799952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.800271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.800426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.800580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.800740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.800913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801430 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.801906 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802241 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.802936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803250 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.803889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.804870 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.805849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.806019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.806340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.806522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.806679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.806976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.807151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.807328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.807498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.807782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.807963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.808980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.809206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.809362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.809526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.809692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.809692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.810985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.811939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.812890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.813186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.813377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.813532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.813686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.813855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814810 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.814973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815134 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.815931 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.816090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.817248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.817418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.817573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.817733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.817888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818713 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.818874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.819979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.820995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.821972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822134 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822633 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822798 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.822952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823106 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.823899 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824052 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824204 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.824870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.825902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.826056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.826210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.826930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.827104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.827590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.827752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.827752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.828848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.829866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.830855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.831826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.832847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.833215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.833372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.833534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.833696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.833852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834346 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.834814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.835829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836003 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836319 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.836953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.837152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.837314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.837468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.837622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.837782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.838942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.839872 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.840734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.841916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.842932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.843758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844373 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.844705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.845856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.846024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.846187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.846350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.846511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.847404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.847595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.847754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.848444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.848612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.848767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.848931 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.849915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.850937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.851895 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.852856 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853010 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.853971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.854123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.854326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855532 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.855860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856475 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856637 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.856978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.857181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.857492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.857492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.857795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.857968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858596 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.858929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.859965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.860990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861667 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.861998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.862316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.862858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.863199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.864605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.864761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.864915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.865892 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.866847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.867926 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.868905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.869957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.870257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.870413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.870611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.870611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.870922 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.871855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.872967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873493 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.873965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874448 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.874934 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.875892 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876542 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.876852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877209 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.877945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878454 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.878944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.879237 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.879407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.879569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.879733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.879898 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.880897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.881942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.882989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883158 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.883950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884744 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.884898 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885071 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885561 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885561 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.885878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886513 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.886974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.887127 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.887289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.887462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.887624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.887804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.888848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889698 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.889861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.890918 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891071 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.891936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892252 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.892886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.893171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.893370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.893539 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.893703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.893858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.894916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895491 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.895976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896475 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.896975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.897939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.898374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.898374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.898669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.898831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.898986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899616 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.899924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.900927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.901925 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.902093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.902255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.902428 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.902428 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.902730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.903593 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.903759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.903914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.904896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.905381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.905550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.905711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.905879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906197 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906513 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.906844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.907053 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.907221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.907413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.907598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.907839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.908046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.908367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.908577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.908776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.908974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.909181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.909386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.909589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.909780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.909978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.910169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.910953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911163 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.911950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.912255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.912411 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.912581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.912736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.912890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.913072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.913235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.913399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.913590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.913834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.914985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915459 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915615 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.915933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916577 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916741 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.916909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.917143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.917570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.917733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.917899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918411 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.918973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919766 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.919927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920847 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.920943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921478 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.921897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.922928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.923907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924269 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.924967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.925979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.926096 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.926693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.926775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.926848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.926919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927013 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.927949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928867 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.928955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929794 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.929982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930076 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.930977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.931993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932579 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932808 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.932902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933735 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.933910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934005 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934835 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.934921 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.935989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.936881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937276 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.937888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.939598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.940887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.941349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.941759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.942182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.942955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.942955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.943211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.943483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.943801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.944138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.944458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.944777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.945195 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.945437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.945755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.946723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.946723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.946723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.947037 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.947357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.947694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.948023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.948338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.948676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.949031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.949394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.949714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.950065 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.951692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.952058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.952399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.952727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:32:04.952986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:32:05.087358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO dbcounter [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Registered counter for database nova_api Aug 06 01:32:05.105920 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO dbcounter [None req-a691439c-4554-4285-886b-49aec118087c None None] Registered counter for database nova_api Aug 06 01:32:05.107775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_db.sqlalchemy.engines [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.116076 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writer thread running {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.126880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_db.sqlalchemy.engines [None req-a691439c-4554-4285-886b-49aec118087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.133584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writer thread running {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.173453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.context [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63b0eb87-9452-4c97-8ca1-d697fc2186af(cell1) {{(pid=124314) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 01:32:05.177519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:05.178007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:05.179611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:05.180353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:05.180809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:05.182879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:05.184942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO dbcounter [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Registered counter for database nova_cell0 Aug 06 01:32:05.189001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO dbcounter [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Registered counter for database nova_cell1 Aug 06 01:32:05.190316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.context [None req-a691439c-4554-4285-886b-49aec118087c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63b0eb87-9452-4c97-8ca1-d697fc2186af(cell1) {{(pid=124313) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 01:32:05.194533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:05.195027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:05.196099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_db.sqlalchemy.engines [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.196657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:05.197437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_db.sqlalchemy.engines [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.197573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:05.197912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:05.199923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a691439c-4554-4285-886b-49aec118087c None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:05.201984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO dbcounter [None req-a691439c-4554-4285-886b-49aec118087c None None] Registered counter for database nova_cell0 Aug 06 01:32:05.204133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writer thread running {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.205429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writer thread running {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.206086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO dbcounter [None req-a691439c-4554-4285-886b-49aec118087c None None] Registered counter for database nova_cell1 Aug 06 01:32:05.213599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_db.sqlalchemy.engines [None req-a691439c-4554-4285-886b-49aec118087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.214936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_db.sqlalchemy.engines [None req-a691439c-4554-4285-886b-49aec118087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.221571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writer thread running {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.223707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writer thread running {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.355021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO dbcounter [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Registered counter for database nova_cell0 Aug 06 01:32:05.362192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_db.sqlalchemy.engines [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.367671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writer thread running {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.371125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO dbcounter [None req-a691439c-4554-4285-886b-49aec118087c None None] Registered counter for database nova_cell0 Aug 06 01:32:05.378077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_db.sqlalchemy.engines [None req-a691439c-4554-4285-886b-49aec118087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:32:05.383224 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writer thread running {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:32:05.686462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: WARNING keystonemiddleware.auth_token [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:32:05.694448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: WARNING keystonemiddleware.auth_token [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:32:05.702456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: WARNING keystonemiddleware.auth_token [None req-a691439c-4554-4285-886b-49aec118087c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:32:05.710365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: WARNING keystonemiddleware.auth_token [None req-a691439c-4554-4285-886b-49aec118087c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:32:06.038455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: WARNING keystonemiddleware.auth_token [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:32:06.044466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: WARNING keystonemiddleware.auth_token [None req-82a2759e-8238-494b-8d0a-4c3e7b695db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:32:06.050706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56303b6d09c0 pid: 124314 (default app) Aug 06 01:32:06.055365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: WARNING keystonemiddleware.auth_token [None req-a691439c-4554-4285-886b-49aec118087c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 01:32:06.061530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: WARNING keystonemiddleware.auth_token [None req-a691439c-4554-4285-886b-49aec118087c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 01:32:06.068762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56303b6d09c0 pid: 124313 (default app) Aug 06 01:32:41.250980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:41.256422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:41.259483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:41.261200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:42.916743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8c93c49d-5a4d-4105-b67f-91b7f146b7d4 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Action: 'create', calling method: .version_select at 0x7fbff5872e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1896728965", "metadata": {"Type": "work"}}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8c93c49d-5a4d-4105-b67f-91b7f146b7d4 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 122 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:32:42.930436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1896728965", "metadata": {"Type": "work"}}} Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: Aug 06 01:32:42.932106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1896728965', 'metadata': {'Type': 'work'}}}} Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise error Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:42.933173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 01:32:42.934722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 01:32:42.936057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 01:32:42.936057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:42.939597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8c93c49d-5a4d-4105-b67f-91b7f146b7d4 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:42.940943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8c93c49d-5a4d-4105-b67f-91b7f146b7d4 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.705743 Aug 06 01:32:42.955572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:42.956860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:42.957582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:42.961462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Aug 6 01:32:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1725 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:32:42.961601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-da92c64c-d4da-49e6-8980-63c64e884b18 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Action: 'create', calling method: .version_select at 0x7fbff5832a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1270799944", "metadata": {"Type": "work"}}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-da92c64c-d4da-49e6-8980-63c64e884b18 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 120 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:32:43.464789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1270799944", "metadata": {"Type": "work"}}} Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:32:43.485459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1270799944', 'metadata': {'Type': 'work'}}}} Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise error Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi '0' Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:43.486613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 01:32:43.488568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 01:32:43.493413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 01:32:43.493413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.493413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-da92c64c-d4da-49e6-8980-63c64e884b18 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:43.493413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-da92c64c-d4da-49e6-8980-63c64e884b18 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.508780 Aug 06 01:32:43.493413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Aug 6 01:32:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 511 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0ddf2afc-f54b-47a1-989f-db04bca7cf60 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Action: 'create', calling method: .version_select at 0x7fbff56c4940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1763971458", "metadata": {"Type": "work"}}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0ddf2afc-f54b-47a1-989f-db04bca7cf60 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 119 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:32:43.494799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1763971458", "metadata": {"Type": "work"}}} Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: Aug 06 01:32:43.498399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1763971458', 'metadata': {'Type': 'work'}}}} Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise error Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi '' Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:43.500605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 01:32:43.504822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 01:32:43.508288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 01:32:43.508288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:43.508288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0ddf2afc-f54b-47a1-989f-db04bca7cf60 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:43.508288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0ddf2afc-f54b-47a1-989f-db04bca7cf60 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018935 Aug 06 01:32:43.510552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Aug 6 01:32:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:32:43.530027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b249b2ab-0c97-4691-ad34-441560afaca5 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Calling method '.version_select at 0x7fbff5fc61f0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:44.138525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-b249b2ab-0c97-4691-ad34-441560afaca5 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] HTTP exception thrown: Volume tempest-invalid-13339057 could not be found. Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b249b2ab-0c97-4691-ad34-441560afaca5 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-13339057 HTTP/1.1 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:32:44.143067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Volume tempest-invalid-13339057 could not be found. Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'tempest-invalid-13339057'} Aug 06 01:32:44.144768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-13339057 could not be found. (HTTP 404) (Request-ID: req-49790668-2dd3-4a82-817e-00ab724ffefb) Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.145726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:32:44.147101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-13339057 could not be found. Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:32:44.148321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-13339057 could not be found. Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-13339057 could not be found. Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b249b2ab-0c97-4691-ad34-441560afaca5 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 404 to user: Volume tempest-invalid-13339057 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b249b2ab-0c97-4691-ad34-441560afaca5 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-13339057" status: 404 len: 97 microversion: 2.1 time: 0.628378 Aug 06 01:32:44.150049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Aug 6 01:32:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-13339057 => generated 97 bytes in 630 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 06 01:32:44.158894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-36e2b6bd-cfae-4a19-aaf5-c515200d25aa tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006141 Aug 06 01:32:44.162004 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Aug 6 01:32:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 01:32:44.171028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1f1fbfd5-589b-491b-8c5c-77c2939500d7 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004235 Aug 06 01:32:44.171539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Aug 6 01:32:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 01:32:44.188357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-da2aa639-ba50-43cc-bd01-a2aa072ea37d tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Calling method '.version_select at 0x7fbff567cc10>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:44.788558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-da2aa639-ba50-43cc-bd01-a2aa072ea37d tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] HTTP exception thrown: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-da2aa639-ba50-43cc-bd01-a2aa072ea37d tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/os-volumes/d065c3c3-5f22-4f64-89b7-f0eca085702e HTTP/1.1 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:32:44.795092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'd065c3c3-5f22-4f64-89b7-f0eca085702e'} Aug 06 01:32:44.796454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. (HTTP 404) (Request-ID: req-345d0a26-c70e-45f8-aabf-c27f3d586971) Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.797305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:32:44.798726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 01:32:44.800242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. Aug 06 01:32:44.802095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.805111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-da2aa639-ba50-43cc-bd01-a2aa072ea37d tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 404 to user: Volume d065c3c3-5f22-4f64-89b7-f0eca085702e could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:44.805111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-da2aa639-ba50-43cc-bd01-a2aa072ea37d tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/d065c3c3-5f22-4f64-89b7-f0eca085702e" status: 404 len: 109 microversion: 2.1 time: 0.626620 Aug 06 01:32:44.810638 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:32:44 2022] DELETE /compute/v2.1/os-volumes/d065c3c3-5f22-4f64-89b7-f0eca085702e => generated 109 bytes in 633 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:32:44.815937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-93eb01b4-12ef-459f-9d66-7454285994c1 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Calling method '.version_select at 0x7fbff5720d30>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:44.887023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-93eb01b4-12ef-459f-9d66-7454285994c1 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] HTTP exception thrown: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-93eb01b4-12ef-459f-9d66-7454285994c1 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Request method failure captured: Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/os-volumes/f4275150-5961-4250-8611-aded77b9661a HTTP/1.1 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cS59ndKX3O6oqV-Wx7ZrqG6EwZBtoAqpP7rTY0Wy911IWoYO3X8j8cApuw6BIkRKmOrt0cU7JUIgPMmm1m1ZkPHKRdBQ9z-7w6vOqW94jC3-pvcdjeuaRaz--vRGdwmvLxIcS-ZBr4E9GFbydI3j7H9sWVCo_V45L9_d8myAr-o4k0 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:32:44.889003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4a60a35d1b246babe9832dc26bb4450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4a60a35d1b246babe9832dc26bb4450"}]}] Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: a4a60a35d1b246babe9832dc26bb4450 Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesNegativeTest-354703312 Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: f9fa23907107401ebf143f7e550ae149 Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesNegativeTest-354703312-project Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'f4275150-5961-4250-8611-aded77b9661a'} Aug 06 01:32:44.890271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. (HTTP 404) (Request-ID: req-7e026b7a-90bb-4899-b18c-b9563a4deeac) Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.891589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:32:44.892999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 01:32:44.894719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-93eb01b4-12ef-459f-9d66-7454285994c1 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] Returning 404 to user: Volume f4275150-5961-4250-8611-aded77b9661a could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-93eb01b4-12ef-459f-9d66-7454285994c1 tempest-VolumesNegativeTest-354703312 tempest-VolumesNegativeTest-354703312-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f4275150-5961-4250-8611-aded77b9661a" status: 404 len: 109 microversion: 2.1 time: 0.079865 Aug 06 01:32:44.896238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:32:44 2022] GET /compute/v2.1/os-volumes/f4275150-5961-4250-8611-aded77b9661a => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:32:45.381635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c72afdf8-6d5d-450c-83ae-d6a738798e20 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55c7820>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:45.487614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c72afdf8-6d5d-450c-83ae-d6a738798e20 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/624b9ca2-37ec-40ed-a16f-54715f5e92b2" status: 200 len: 350 microversion: 2.1 time: 0.117171 Aug 06 01:32:45.489014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:32:45 2022] GET /compute/v2.1/os-volumes/624b9ca2-37ec-40ed-a16f-54715f5e92b2 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:47.220261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-db7d427b-26c0-43a5-9d31-735a46a9f4f7 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55c9f70>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:47.366128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-db7d427b-26c0-43a5-9d31-735a46a9f4f7 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/93e45941-ccb2-4835-8edf-762e59ace863" status: 200 len: 351 microversion: 2.1 time: 0.153390 Aug 06 01:32:47.367190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:32:47 2022] GET /compute/v2.1/os-volumes/93e45941-ccb2-4835-8edf-762e59ace863 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:49.337275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-92651c2f-821e-4442-9937-d997067905c5 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55c7f70>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:49.598748 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-92651c2f-821e-4442-9937-d997067905c5 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c4d19848-8dc5-4e34-be9e-386e59f34978" status: 200 len: 351 microversion: 2.1 time: 0.272195 Aug 06 01:32:49.599317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:32:49 2022] GET /compute/v2.1/os-volumes/c4d19848-8dc5-4e34-be9e-386e59f34978 => generated 351 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:49.617757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3ad67191-62f8-493c-8ffa-55208a74faf5 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55d05e0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:50.062716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3ad67191-62f8-493c-8ffa-55208a74faf5 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.454295 Aug 06 01:32:50.063386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Aug 6 01:32:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:50.082598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b61f02f-5d97-4de3-b456-56bea615e409 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55c7b80>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:50.426166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2b61f02f-5d97-4de3-b456-56bea615e409 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.352015 Aug 06 01:32:50.427022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Aug 6 01:32:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:50.440352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-56c9d006-4859-479b-ac7d-d50e33ef734d tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff5720790>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:50.716613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-56c9d006-4859-479b-ac7d-d50e33ef734d tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.280443 Aug 06 01:32:50.718912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Aug 6 01:32:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:50.733858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5243df7e-e17e-4451-99a9-c9cfc11ace03 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55df9d0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:50.972995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5243df7e-e17e-4451-99a9-c9cfc11ace03 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.244079 Aug 06 01:32:50.974212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Aug 6 01:32:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:50.987862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c2ca6548-1004-408e-a186-805be5d38058 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55da5e0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:51.360302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c2ca6548-1004-408e-a186-805be5d38058 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.376654 Aug 06 01:32:51.360880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Aug 6 01:32:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:51.375084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-58b2f8f7-60e0-4943-8c82-8244902c2cda tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55df8b0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:51.689102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-58b2f8f7-60e0-4943-8c82-8244902c2cda tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.317656 Aug 06 01:32:51.697950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Aug 6 01:32:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:51.704151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f0c43689-c1e7-4ed2-a4d4-90d047dbd2c9 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55de820>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:51.935300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f0c43689-c1e7-4ed2-a4d4-90d047dbd2c9 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.236457 Aug 06 01:32:51.936677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Aug 6 01:32:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:51.949465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-acf9f905-2625-4251-9347-5e8eace2ac13 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] Calling method '.version_select at 0x7fbff55c78b0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:52.082147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-acf9f905-2625-4251-9347-5e8eace2ac13 tempest-VolumesTestJSON-1605601560 tempest-VolumesTestJSON-1605601560-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.135332 Aug 06 01:32:52.097042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Aug 6 01:32:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:52.932336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1339423312", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "networks": [{"uuid": "de2aa80e-8f5d-4f9c-b9ab-8d872d5bd93e"}]}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:32:53.077661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] validate_networks() for [('de2aa80e-8f5d-4f9c-b9ab-8d872d5bd93e', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:32:54.279008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:32:54.279586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:32:54.279998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:32:54.280674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:32:54.281263 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:32:54.309845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:54.310574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:54.311169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:54.312167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:54.312876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:54.315120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:54.386481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Getting quotas for project b124d9abc46d4e85927cf1b40dd4a171. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:32:54.410179 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Getting quotas for user 5823f66f313843ddac68ff7a951321ae and project b124d9abc46d4e85927cf1b40dd4a171. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:32:54.439665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:32:54.445231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:32:54.601750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-acda1017-16b4-4e22-bfc9-8053f002ebcc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260848 Aug 06 01:32:54.603408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:32:54.616424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0c82b9c1-2a93-46f7-ba28-c6c5bc5634ce tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:54.617211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0c82b9c1-2a93-46f7-ba28-c6c5bc5634ce tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:32:54.820421 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0c82b9c1-2a93-46f7-ba28-c6c5bc5634ce tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:32:54.849372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0c82b9c1-2a93-46f7-ba28-c6c5bc5634ce tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1215 microversion: 2.1 time: 0.237596 Aug 06 01:32:54.850187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:32:54 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:55.879259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-dcce8d86-a627-4079-866b-9e0598060e8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:55.880581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-dcce8d86-a627-4079-866b-9e0598060e8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:32:56.476160 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dcce8d86-a627-4079-866b-9e0598060e8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:32:56.519177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-dcce8d86-a627-4079-866b-9e0598060e8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1215 microversion: 2.1 time: 0.643333 Aug 06 01:32:56.521352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:32:55 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1215 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:57.545869 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:57.546777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:32:57.572563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:57.573408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:57.575282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:57.576557 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:57.578439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:57.579403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:57.921147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-68856c16-0e3f-4a25-9ecf-0859e9c5015a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: .version_select at 0x7fbff4483f70>, body: {"keypair": {"name": "tempest-keypair-1285877458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr4gWrO7MWdeAQNpzJMkcwWDDNJA4Ab/qNRx5F3arxKdbB3u6vjN+aEOqJdtSLm4Wg1zRXUp1ohGzrXgQqFHCX66C7pkCboKq1RX3fOoCv4OHAV+ENK1TLjvcySzTxj2w=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:32:57.997982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-68856c16-0e3f-4a25-9ecf-0859e9c5015a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:32:58.021643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-68856c16-0e3f-4a25-9ecf-0859e9c5015a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for user 2455ea8abba547669fe22d2065a726c6 and project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:32:58.149275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-68856c16-0e3f-4a25-9ecf-0859e9c5015a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.346787 Aug 06 01:32:58.149903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 12/23] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:32:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:32:58.595280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:32:58.662806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-46e27589-27fa-4f52-a04a-b1a1b56aedb7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1267 microversion: 2.1 time: 1.117512 Aug 06 01:32:58.670219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:32:57 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1267 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:32:59.687834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:32:59.690297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:32:59.714084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:59.714696 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:59.715148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:32:59.715888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:32:59.720516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:32:59.721182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:00.223495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:00.251033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-61644b6a-ea44-41c1-961f-ae4a9d825cdf tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1273 microversion: 2.1 time: 0.567281 Aug 06 01:33:00.252339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:32:59 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1273 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:00.852377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2042707507", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:01.149580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] validate_networks() for [('c160c4ef-4511-4d2d-89d0-59e11df0d580', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:01.275882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:01.276514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:01.282609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:01.283103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:01.283543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:01.285393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:01.286040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:01.286648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:01.732674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:01.749319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9bcba8e3-e09f-4e6e-bb2a-e5a132aae3cd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.470519 Aug 06 01:33:01.756940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 14/26] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:01 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:02.585082 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:02.586571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:02.587331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:02.587991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:02.588682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:02.614371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:02.615333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:02.616023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:02.617087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:02.617824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:02.618580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:02.659244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:02.665920 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f98b9d52-6f73-483f-a752-bff87783ce83 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: .version_select at 0x7fbff43def70>, body: {"keypair": {"name": "tempest-keypair-1816639418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkPhEvQT1An/KhvaBuVhs39pUJQoJiPhmLXgyl8dNm/htCB70E/5lQGHWj2HKl+H8kxcam13pF5rnwJJn7kAVN1dkawFA6bh+2d4ieWjKScyNKyfs39EL4502mcWoYAkw=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:02.688343 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for user 37c704ce557c4f309cf00ef32646235f and project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:02.704782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-f98b9d52-6f73-483f-a752-bff87783ce83 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for project 16078c76f554419992faa7570fe5aba1. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:02.714913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-f98b9d52-6f73-483f-a752-bff87783ce83 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for user 42ade772e11a4725928ab12d3bccc4a7 and project 16078c76f554419992faa7570fe5aba1. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:02.718484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:02.727757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:02.775523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f98b9d52-6f73-483f-a752-bff87783ce83 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.212709 Aug 06 01:33:02.777941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 15/27] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Aug 6 01:33:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 06 01:33:02.788683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:02.789528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:02.805699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:02.806371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:02.808811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:02.809775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:02.810376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:02.811916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:02.950833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-170a5d91-aaff-431f-98d5-1595a1a8cbe5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.246449 Aug 06 01:33:02.952252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 13/28] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:33:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:33:02.964973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-78bf7a4f-82be-4295-8f39-6446db474ee6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:02.967226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-78bf7a4f-82be-4295-8f39-6446db474ee6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:03.088136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:03.099349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7ddfdce2-bb76-4660-b9be-c977f3b11f89 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.318790 Aug 06 01:33:03.113819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 16/29] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:02 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:03.145316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-78bf7a4f-82be-4295-8f39-6446db474ee6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:03.154303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-78bf7a4f-82be-4295-8f39-6446db474ee6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1222 microversion: 2.1 time: 0.193903 Aug 06 01:33:03.154953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 14/30] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:02 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:03.346356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1283898888", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:03.348456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-8616514", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ba03ae0-258d-4135-90c0-73573adb81fa"}], "security_groups": [{"name": "tempest-securitygroup--267637928"}], "key_name": "tempest-keypair-1285877458", "user_data": "}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:03.718556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] validate_networks() for [('c160c4ef-4511-4d2d-89d0-59e11df0d580', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:04.216630 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] validate_networks() for [('8ba03ae0-258d-4135-90c0-73573adb81fa', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:04.353128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:05.684919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:05.685566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:05.686129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:05.686549 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:05.686972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:05.704075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:05.704577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:05.708249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:05.709202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:05.709580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:05.710016 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:05.767372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:05.778597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for user 37c704ce557c4f309cf00ef32646235f and project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:05.803758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:05.806769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:05.870696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-190c63d4-06bf-458d-bc15-eb411068bb93 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.538675 Aug 06 01:33:05.871968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 15/31] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:33:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:33:05.877066 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:05.878538 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:05.886278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:05.887004 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:05.887651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:05.888508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:05.889242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:05.889814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:05.973073 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:05.974686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:05.975329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:05.976456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:05.977303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:06.015340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:06.016047 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:06.017327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:06.018257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:06.019752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:06.021523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:06.076204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:06.114594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for user 2455ea8abba547669fe22d2065a726c6 and project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:06.185229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:06.199623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:06.237735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:06.248052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c306dc0e-48d6-4cf1-8fdd-74f8c4c5312e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.374759 Aug 06 01:33:06.250531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:05 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:06.357019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c798285-436b-4040-90b1-6228ed48a138", "tag": "73adc3cd-6972-476a-a899-95cebd699ff5"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:06.390945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4f6041f4-165d-4497-923c-84d4f5fb88ec tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.075704 Aug 06 01:33:06.400438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 17/33] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:33:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 3087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:33:06.403184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:06.403823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:06.404443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:06.408461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f7fcf45a-0f73-4684-88e9-8f0a9c9e3020 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:06.410156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f7fcf45a-0f73-4684-88e9-8f0a9c9e3020 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:06.502053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Creating event network-changed:73adc3cd-6972-476a-a899-95cebd699ff5 for instance 8c798285-436b-4040-90b1-6228ed48a138 on hv-cinder-85200 Aug 06 01:33:06.520299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 01:33:06.520759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c58e9ad6-5fee-40b2-9da0-bed63776a705 req-f6c3daa6-ea32-4f9a-9fea-7456dd287dd9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 01:33:06.531197 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:06.531696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:06.535035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:06.535883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:06.536365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:06.536802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:06.576661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.compute.rpcapi [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 01:33:06.577487 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] Releasing lock "compute-rpcapi-router" {{(pid=124314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 01:33:06.604169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f7fcf45a-0f73-4684-88e9-8f0a9c9e3020 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:06.611662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f7fcf45a-0f73-4684-88e9-8f0a9c9e3020 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1222 microversion: 2.1 time: 0.209690 Aug 06 01:33:06.616505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:06 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1222 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:06.646231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a0bae733-4d5b-4bac-a9e8-3f0654bcbe22 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:06.647148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a0bae733-4d5b-4bac-a9e8-3f0654bcbe22 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:06.667356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-673ffd2e-fa6c-4ae4-94ae-3e69775f9086 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415322 Aug 06 01:33:06.668326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:06.756413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a0bae733-4d5b-4bac-a9e8-3f0654bcbe22 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:06.767139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a0bae733-4d5b-4bac-a9e8-3f0654bcbe22 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1235 microversion: 2.1 time: 0.147120 Aug 06 01:33:06.768390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:06 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1235 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:07.278359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:07.279078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:07.307048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.307565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.311633 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:07.312407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.327170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.328466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:07.355384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-142866278", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85316ce2-fda5-4fa0-8d98-fc3e80e275cc"}], "security_groups": [{"name": "tempest-securitygroup--221117663"}], "key_name": "tempest-keypair-1816639418", "user_data": "}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:07.529483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] validate_networks() for [('85316ce2-fda5-4fa0-8d98-fc3e80e275cc', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:07.582866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:07.591426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c484e255-4a68-4fbd-b412-0472ad7fe3d4 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.317575 Aug 06 01:33:07.596151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 18/37] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:07 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:07.638677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:07.639403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:07.649952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.650831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.651497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:07.653518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.654885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.655492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:07.803279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:07.811852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-25df8041-09d8-451e-9424-e762e1871b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1226 microversion: 2.1 time: 0.177368 Aug 06 01:33:07.814554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:07 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:07.822072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:07.822778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:07.841895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.842730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.845366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:07.846644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:07.847686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:07.851784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.056422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:08.066895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-120b3847-0733-4637-97e9-f95cf68f0dc1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1239 microversion: 2.1 time: 0.251155 Aug 06 01:33:08.068929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:07 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1239 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:08.519443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:08.520016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:08.520855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:08.521595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:08.522445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:08.543132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.544701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.547627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.548493 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.548966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.551482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.613731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for project 16078c76f554419992faa7570fe5aba1. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:08.638524 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:08.642523 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:08.656125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for user 42ade772e11a4725928ab12d3bccc4a7 and project 16078c76f554419992faa7570fe5aba1. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:08.656958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.659236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.662158 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.663264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.665448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.666908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.691007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:08.705830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:08.857284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bb8f56f5-b549-45e1-a579-73ecde336802 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.506847 Aug 06 01:33:08.861786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 20/40] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Aug 6 01:33:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 06 01:33:08.886336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:08.889854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:08.907347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.908317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.918081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:08.921450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:08.923843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:08.925025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:09.179509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.191530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f3a6e308-7b66-4965-86bd-832ea113a814 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.573726 Aug 06 01:33:09.196485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:08 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:09.198660 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.202695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:09.203571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:09.219347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-54838f98-b90a-4a75-81c4-a82f98f09f8e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1226 microversion: 2.1 time: 0.354597 Aug 06 01:33:09.224230 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:08 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1226 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:09.231700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:09.245410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:09.266699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:09.268006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:09.275475 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:09.276374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:09.276875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:09.279934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:09.487776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.500177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.521746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.524521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-17cda999-c3a4-4bd0-ae8c-154711b87d70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1281 microversion: 2.20 time: 0.326715 Aug 06 01:33:09.565913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:09.566557 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:09 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1281 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:09.578441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-65595140-041a-4168-bd1c-8250ece778ee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1231 microversion: 2.1 time: 0.350031 Aug 06 01:33:09.588264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 22/44] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:09 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1231 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:10.228523 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:10.229354 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:10.248703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:10.249767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:10.255395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:10.258317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.262394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.265329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:10.269220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.270463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.270910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.271353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:10.272999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.274258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:10.277729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.278787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.281339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:10.840476 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:10.860550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-554e280f-160b-4635-8cc5-4b6e683fabe1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1274 microversion: 2.1 time: 0.618249 Aug 06 01:33:10.880996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:10 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1274 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:10.907090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:10.914350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:10.947754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.952600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.953236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:10.956307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:10.957663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:10.958348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:11.286506 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:11.306155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:11.310345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:11.314458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1d2614f1-4a5d-4ce9-91e1-9323e1cc497d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1285 microversion: 2.20 time: 0.430197 Aug 06 01:33:11.317510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:10 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1285 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:11.332389 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:11.333939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:11.407314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:11.421354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:11.421801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:11.422555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:11.423021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:11.423450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:11.498567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:11.550266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-89edd93b-98e0-48fb-af54-06463182fd86 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 1.328642 Aug 06 01:33:11.551054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 23/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:10 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:11.678086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:11.699000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1a51bf8f-4ca6-43ec-93cf-521d9e722935 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1287 microversion: 2.1 time: 0.379246 Aug 06 01:33:11.700007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:11 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1287 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:11.887821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:11.888464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:11.922734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:11.927377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:11.928045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:11.929020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:11.929675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:11.930288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.250000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:12.261009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fb0419d4-4f61-41f7-9050-d568d84288c9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1274 microversion: 2.1 time: 0.375967 Aug 06 01:33:12.262155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:11 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:12.342144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:12.343997 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:12.359364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.360664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.361302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.362278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.366266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.367490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.580277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:12.594315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:12.597569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:12.601304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d2cb72da-b137-4c5c-8836-6594d9fe2b39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1285 microversion: 2.20 time: 0.263350 Aug 06 01:33:12.602702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:12 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:12.602838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:12.604793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:12.620321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.624435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.625023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.627336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.629820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.630252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.726690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:12.732010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:12.767159 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.770729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.771252 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.772086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:12.772456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:12.772889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:12.946549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:12.955275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b6973675-9210-4744-aea4-091319dc3bde tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1295 microversion: 2.1 time: 0.235765 Aug 06 01:33:12.974651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:12 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:13.290615 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:13.291393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:13.348051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:13.358335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:13.358796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:13.364481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:13.365084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:13.370281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:14.159880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:14.195472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6c6a92b1-0b56-49ed-9831-a99dcc5ba3d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 1.606396 Aug 06 01:33:14.237855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 25/52] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:12 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:14.262471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:14.272959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:14.290913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:14.295581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:14.302161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:14.305281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:14.311812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:14.314586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:14.316131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:14.330515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2ad8a678-5215-4216-963a-1517dcd95b24 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1274 microversion: 2.1 time: 1.039037 Aug 06 01:33:14.335262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:13 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1274 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:14.353263 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:14.353972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:14.398972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:14.403078 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:14.405482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:14.414131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:14.418141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:14.420178 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:14.974522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:14.992745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:14.997251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:15.005116 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5bcc4beb-e537-4857-8d2b-03a6c73930dd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1333 microversion: 2.20 time: 0.761452 Aug 06 01:33:15.006918 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 26/54] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:14 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1333 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:15.143036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:15.158432 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-47292943-d045-4a93-a2be-bd7939146158 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1293 microversion: 2.1 time: 0.821186 Aug 06 01:33:15.159656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 29/55] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:14 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1293 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:15.232063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:15.233951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:15.251930 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:15.253413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:15.254813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:15.258035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:15.259494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:15.260963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:15.359962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:15.360588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:15.373607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:15.374312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:15.374791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:15.377217 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:15.379775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:15.380335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:15.629425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:15.644068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cace5b8f-03a1-4f11-9195-e1269a6f7aa0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1280 microversion: 2.1 time: 0.286504 Aug 06 01:33:15.644754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 30/56] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:15 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:15.961973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:15.975601 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ecb4e95d-2ed3-467b-b86c-0bcb2904365d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.754618 Aug 06 01:33:15.977683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 27/57] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:15 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:16.048690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:16.049281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:16.063701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.065887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.066706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:16.067490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.067958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.070587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:16.183200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:16.183816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:16.199786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.200368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.200805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:16.201602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.202162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.202594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:16.368544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:16.382702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:16.384368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:16.387056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b7d152ea-5663-4687-903c-e707305e4bcc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1339 microversion: 2.20 time: 0.357214 Aug 06 01:33:16.390088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 31/58] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:16 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:16.551522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:16.573266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:16.585201 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f72aea79-d2b2-41de-bace-2281cc5e6604 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1293 microversion: 2.1 time: 0.406339 Aug 06 01:33:16.589072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:16 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1293 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:16.675919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:16.676549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:16.688320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.688836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.691473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:16.694800 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:16.695329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:16.700089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.003844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:17.004467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:17.014601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.023704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.024204 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.024644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.027063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-080f21da-65db-4d15-a503-70c5f5aa98ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1280 microversion: 2.1 time: 0.353071 Aug 06 01:33:17.028206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:16 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:17.030961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.032972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.037640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.415987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:17.416612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:17.423201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.424113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.428980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.431061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.431656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.432529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.478789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:17.617277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.628992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c2c1acef-043a-4571-a906-7a67e377cf57 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.630880 Aug 06 01:33:17.642262 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 29/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:16 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:17.651998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:17.653611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:17.660729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.661620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.662712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.663825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:17.664655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:17.665784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:17.774890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.796483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.798954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.802887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-40f18197-a281-41fc-9de8-605e6694ba5d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1339 microversion: 2.20 time: 0.390806 Aug 06 01:33:17.806392 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 33/62] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:17 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1339 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:17.857912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:17.870562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-14c0ad18-5b60-4a01-bd9e-3626ee45c0d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1293 microversion: 2.1 time: 0.224787 Aug 06 01:33:17.873210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:17 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:18.059370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:18.063896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:18.089197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.091679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.093064 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.094473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.099497 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.104054 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.548650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:18.558957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-63845c6d-fde5-49d0-8872-61e86aba4cf1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.510691 Aug 06 01:33:18.569122 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:18 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:18.656550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:18.658686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:18.665194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.665449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.666132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.666837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.667349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.667705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.828240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:18.828461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:18.831697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=4 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:18.832722 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=32 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:18.845703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.848723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.848723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.848723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.848723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.849014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.915986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:18.923324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fc6900ea-5047-4cf9-8bab-c379a201c5a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.273555 Aug 06 01:33:18.924728 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:18 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:18.930578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:18.931459 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:18.938751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.939505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.942148 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.942939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:18.943674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:18.944188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:18.948585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:19.078998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:19.088229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:19.090103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:19.091591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9c501190-117d-417f-abe8-c16433a47a3b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.267595 Aug 06 01:33:19.092655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 35/66] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:18 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:19.493016 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=18 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:19.576273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:19.585973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e039401c-bdb5-40dd-a73a-6144b13c346d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.659853 Aug 06 01:33:19.586570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:18 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:19.588171 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:19.589551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:19.599180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:19.602927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:19.603769 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:19.607186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:19.608515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:19.611088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:19.907303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:19.917012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-22d0f349-6aa8-4f90-a907-e57963d0b59d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.334249 Aug 06 01:33:19.920029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 36/68] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:19 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:19.944143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:19.944876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:19.953694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:19.955592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:19.957508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:19.958386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:19.960990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:19.961708 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:20.115825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:20.116440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:20.131354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:20.134924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:20.136686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:20.137811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:20.140678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:20.141188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:20.930971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:20.938993 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-80587e80-9007-4873-987b-e323334345ec tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.998926 Aug 06 01:33:20.952269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:19 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:20.958832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7acdfef-0b50-4561-8f9e-c9159b16d014", "tag": "1da54cea-8621-4d67-b9fe-0f749fe8b99d"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:20.982148 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:20.984819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:20.985304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.000454 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:21.008372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] Creating event network-changed:1da54cea-8621-4d67-b9fe-0f749fe8b99d for instance d7acdfef-0b50-4561-8f9e-c9159b16d014 on hv-cinder-85200 Aug 06 01:33:21.016952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:21.021760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-874e8470-cc43-4c97-aa08-aa3f1e1b6ca2 req-b00c191a-a8f7-41ec-afce-31d97d6b516f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066891 Aug 06 01:33:21.024099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 34/70] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:21.024546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:21.029211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ee1bdbe1-c77e-4673-89eb-e2fc00940b25 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.916184 Aug 06 01:33:21.031724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 37/71] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:20 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:21.037894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:21.039534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:21.040277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:21.040765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:21.051958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.052200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.053786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.054101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.054865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.055271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.056800 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.057541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.058312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.058439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.059424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.059876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.613296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:21.620703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:21.620975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-039ade1e-a73b-403c-bf61-2dbe84a83c5b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.595059 Aug 06 01:33:21.633086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 35/72] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:21 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:21.633300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a239b8a7-357b-42eb-b095-9971c13d7d71 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.598131 Aug 06 01:33:21.633300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:21 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:21.698692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:21.705366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:21.714586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.715062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.715492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.728618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] Creating event network-changed:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:33:21.734827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-56de4c6a-7ba6-4510-9236-df1ebf5acba3 req-b379c7c4-3221-4970-87b1-391000eadd5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111452 Aug 06 01:33:21.735990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 36/74] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:21.960877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:21.961683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:21.968636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.969160 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.969605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:21.970307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:21.970766 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:21.972170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.057412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:22.058125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:22.066613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.067112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.068161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.068876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.069357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.069786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.151259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:22.168594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-34b7942b-a91d-4e7c-af74-fd58fdf1e62b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.213127 Aug 06 01:33:22.169942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:21 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:22.542325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:22.562320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:22.570705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:22.574652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-806361a6-5dcb-4e8b-b851-94582c19375b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.524384 Aug 06 01:33:22.575894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 37/76] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:22 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:22.647595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:22.648888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:22.656580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:22.657447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:22.671386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.673596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.675228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.675867 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.676540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.677646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.678502 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.679480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:22.680257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.680955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:22.682126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:22.682560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.638186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.646375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.654841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4ff69039-f2ff-4667-b775-dd6160e40b2f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 1.003790 Aug 06 01:33:23.655395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fc38da6e-2e49-4980-9630-c20b139d4ceb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 1.013975 Aug 06 01:33:23.655522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 38/77] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:22 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:23.656583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 40/78] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:22 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:23.662176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25b0066-5e40-474a-94a9-d350a71af0ac", "tag": "052f72bc-baad-4627-a6fd-ec1944c9e611"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:23.662346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:23.662973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:23.672611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.673148 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.673319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.673579 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.674985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.675247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.675986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.676524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.677013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.686394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] Creating event network-changed:052f72bc-baad-4627-a6fd-ec1944c9e611 for instance d25b0066-5e40-474a-94a9-d350a71af0ac on hv-cinder-85200 Aug 06 01:33:23.691610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-c589b693-75d6-425b-84d5-4dccbcd368dd req-8403dbb4-f879-433e-81fc-49b53e3bbcdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035039 Aug 06 01:33:23.692223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 39/79] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:23.697578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:23.698276 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:23.704488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.704975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.705440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.706132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.706583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.707224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.902522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.915107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.915265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e6d5629b-50e1-46e1-aa43-9f792f9395fd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.257211 Aug 06 01:33:23.916638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 41/80] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:23 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:23.923007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cee84e-9fda-4bcb-9513-e8b6e343ffaa", "tag": "51c934c5-29f0-4f84-b863-02666b538d5b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:23.928550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.931101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:23.932496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-73779c0d-3e14-4d7c-b765-45712fc23c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.238902 Aug 06 01:33:23.932996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 40/81] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:23 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:23.960447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.961207 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.961916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.988112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Creating event network-changed:51c934c5-29f0-4f84-b863-02666b538d5b for instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa on hv-cinder-85200 Aug 06 01:33:23.989015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 01:33:23.989712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e6398760-7f36-4305-a0a5-d6e7d568a9d5 req-3858c93d-2291-4e84-9b62-c74fa666fc8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 01:33:23.991551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.992017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.992624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:23.993572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:23.994200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:23.994626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.004609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.compute.rpcapi [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 01:33:24.005544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=124313) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 01:33:24.033121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8ca07f61-d4b5-4353-9d07-1a1ae17829a2 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114817 Aug 06 01:33:24.034529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 42/82] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:24.684475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:24.685623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:24.687343 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:24.689761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:24.706344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.707079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.707700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.708322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.708784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.710359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.710852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.711291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.712151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.712438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.713006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.714220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.946593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:24.950711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:24.956209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b62c00f8-4f78-42fe-8fd3-526ca51f568e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.281543 Aug 06 01:33:24.956939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:24 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:24.961729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:24.962381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:24.968635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.969138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.969680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.970365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:24.971554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:24.972131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:24.975916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-398878e3-501a-441f-9eaa-ab9e05b3d0d8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.302358 Aug 06 01:33:24.989675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 41/84] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:24 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:24.996299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:24.997089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:25.004278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:25.004761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:25.005215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:25.006080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:25.006699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:25.007121 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:25.196877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:25.207791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0d3d37d1-18c2-444e-b875-c82d58b254ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.248653 Aug 06 01:33:25.225849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 44/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:24 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:25.251118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:25.264230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:25.273142 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:25.276237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4108f502-457e-451f-9711-d43982a7a6fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.285402 Aug 06 01:33:25.288139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 42/86] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:24 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:25.847336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c798285-436b-4040-90b1-6228ed48a138", "name": "network-vif-plugged", "status": "completed", "tag": "73adc3cd-6972-476a-a899-95cebd699ff5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:25.864219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:25.867326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:25.869116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:25.897618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] Creating event network-vif-plugged:73adc3cd-6972-476a-a899-95cebd699ff5 for instance 8c798285-436b-4040-90b1-6228ed48a138 on hv-cinder-85200 Aug 06 01:33:25.906268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-7d30944f-89cc-4947-ab91-e080f7c1b95d req-c74f8e9f-a9fb-4238-9587-d07a04297716 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178683 Aug 06 01:33:25.911668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 45/87] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:25.978781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:25.980435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:25.991195 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:25.992029 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:25.992853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:25.994230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:25.995171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:25.995778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.004443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:26.009451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:26.039457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.040398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.040859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.046355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.046885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.048556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.482464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.492614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d0a45509-815f-43c4-8227-ab2a1e18c17e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.518569 Aug 06 01:33:26.494772 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 43/88] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:25 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:26.499504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:26.500183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:26.507540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.508354 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.508972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.509877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.510458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.512258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.522405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.531970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-98e41e3c-3c3e-47cf-8baf-a3020cbbc480 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.533742 Aug 06 01:33:26.532568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 46/89] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:25 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:26.540810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:26.551447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:26.578247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.581366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.582042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.582917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:26.602781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:26.605331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:26.878464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.888316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c6208198-e914-4e0c-aaba-8094f1b3e5ea tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.392070 Aug 06 01:33:26.901965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:26 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:26.956864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.971841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.973598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:26.974940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6e8f6895-f5f7-4d72-9038-1137ba93ba27 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.438301 Aug 06 01:33:26.975924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 47/91] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:26 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:27.515085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:27.516478 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:27.525280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:27.525832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:27.526464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:27.527362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:27.528021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:27.528673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:27.555375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:27.556582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:27.577757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:27.579420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:27.585968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:27.587026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:27.587654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:27.588092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:28.037676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.041376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.048932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b73e7f54-9688-45a3-9cba-e1dbde62edf4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.498509 Aug 06 01:33:28.049705 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 48/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:27 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:28.054571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:28.055175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:28.061024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:28.061527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:28.062059 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:28.062622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:28.063069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:28.063489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:28.065831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0dfa6b42-d5ae-4bee-8ded-89464c38c5bc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.554090 Aug 06 01:33:28.066417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 45/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:27 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:28.072228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:28.073035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:28.079315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:28.079684 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:28.080125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:28.081464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:28.081956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:28.082360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:28.272379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.279372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.289355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cda6f5be-d73b-4d9c-a028-198682d9557e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.235318 Aug 06 01:33:28.289355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 49/94] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:28 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:28.289547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.289547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:28.290711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6e079175-8946-4a7b-ae13-fe624da4d249 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.222993 Aug 06 01:33:28.291195 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 46/95] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:28 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:29.069692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:29.070334 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:29.076365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.076846 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.077311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.077992 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.078444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.078861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.086905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:29.087513 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:29.094303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.095100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.095691 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.097089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.097686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.098290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.301838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.304290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.314367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-af16fdea-1ae6-4f21-b3ae-3fda4263327d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.231465 Aug 06 01:33:29.315674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 47/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:29 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:29.316028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a15ca87d-7c4a-46d2-855b-500a0b612ad5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.249907 Aug 06 01:33:29.329075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:29 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:29.329075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:29.329075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:29.335386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.335646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:29.335883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.336322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.336843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:29.337021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.337505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.338014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.344362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.345240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.345828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.347378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:29.348054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:29.348625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:29.350258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:29.554808 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.571664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.574782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.579164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:29.581854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-11c63486-0063-4c5b-a829-9651878e562a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.262660 Aug 06 01:33:29.582799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9a6706a3-d161-41d4-82c1-955723743f13 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.265751 Aug 06 01:33:29.583665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 51/98] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:29 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:29.584338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 48/99] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:29 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:30.335911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:30.336576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:30.341277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:30.341890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:30.343150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.343645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.344088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.344789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.345274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.345689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.348541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.349153 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.349473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.351676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.351676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.351676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.554907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.558820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.563415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1df5615b-cfbb-4897-a25f-e7f6c20bd548 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.231486 Aug 06 01:33:30.564079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 52/100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:30 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:30.567894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9c0de96e-313f-4d76-abd2-588a6ef70786 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.232159 Aug 06 01:33:30.568471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:30 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:30.603788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:30.604419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:30.606689 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:30.607741 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:30.610889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.611385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.612581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.613320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.614021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.614459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.615948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.616530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.617019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.617924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:30.618481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:30.619051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:30.879026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.879488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.883168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:30.887280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c88ff8dd-8af7-47a3-8532-ba9218851115 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.287756 Aug 06 01:33:30.887871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 53/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:30 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:30.889770 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.891491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:30.892731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3b03de30-b574-4f2f-904e-2a0dee538904 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.290584 Aug 06 01:33:30.893389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 50/103] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:30 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:31.585245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:31.585245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:31.591445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:31.592047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:31.592426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.592915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.593385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.594410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.594872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.595749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.599369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.599865 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.600302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.600998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.601524 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.601951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.804633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:31.811793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:31.812987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-aadbdff8-c50a-48d3-a8d5-27fe75a2403b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.233065 Aug 06 01:33:31.813749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 54/104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:31 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:31.821706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7e5a72c8-fd11-437d-820a-d5721a0d1fee tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.234891 Aug 06 01:33:31.822495 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 51/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:31 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:31.912961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:31.913959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:31.915723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:31.916433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:31.919877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.920580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.921217 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.922293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.922747 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.923852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.924775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.925759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.926335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:31.927296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:31.927825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:31.928314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:32.175439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:32.186540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e9da81c9-b35c-4e12-966c-0db07d05b922 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.278344 Aug 06 01:33:32.187230 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 55/106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:31 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:32.188473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:32.197561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:32.199097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:32.200200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f09a5d6d-9500-440c-8e38-f1eea3674f9f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.289042 Aug 06 01:33:32.201093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 52/107] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:31 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:32.834648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:32.835267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:32.843061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:32.843705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:32.844331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:32.844597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:32.845125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:32.846823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:32.847441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:32.848026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:32.852345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:32.852903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:32.853629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:32.854311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:32.854944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:32.855483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.062360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.064387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.070361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-efe13c54-23a7-4da1-8bde-8db53bc5fc40 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.230944 Aug 06 01:33:33.070958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 53/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:32 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:33.073000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d06e0167-a35c-4f75-8d13-c441e9f39a8a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.242762 Aug 06 01:33:33.073608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 56/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:32 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:33.208563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:33.209595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:33.218803 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.219602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.220344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.221944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.222300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:33.222912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:33.223188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.223814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.231720 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.232347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.232793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.233788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.234256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.234686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.436417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.444265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.457409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8f67f0d5-0565-4651-b5b5-2d78bb97ba5c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.247885 Aug 06 01:33:33.457409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 54/110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:33 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:33.457609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.457609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:33.457609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-79fb1e01-a7f7-4fc1-9ea7-3454f66c486e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.236877 Aug 06 01:33:33.459898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1636186834", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "networks": [{"uuid": "d2988fca-a7bb-42e3-8a1b-a033b645849a"}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:33.469479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 57/111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:33 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:33.519099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] validate_networks() for [('d2988fca-a7bb-42e3-8a1b-a033b645849a', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:33.881119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:33.881693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:33.881993 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:33.882392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:33.882797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:33.891471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.891943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.892365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.893747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:33.894200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:33.894617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:33.912514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Getting quotas for project d37acbae2bf64dac8eec9721189268d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:33.916488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Getting quotas for user 3f081e5336f74e21903f11df0b9d95b1 and project d37acbae2bf64dac8eec9721189268d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:33.928249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:33.930610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:33.985516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-84b32371-0023-40a3-983a-c2ff35f25623 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532119 Aug 06 01:33:33.986055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 55/112] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:33:33.997631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2d260761-5116-465d-8040-a0afacac5951 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:33.998254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2d260761-5116-465d-8040-a0afacac5951 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:34.002929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:34.054760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2d260761-5116-465d-8040-a0afacac5951 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.062721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2d260761-5116-465d-8040-a0afacac5951 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1214 microversion: 2.1 time: 0.068764 Aug 06 01:33:34.063305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 58/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:33 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:34.091569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:34.092254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:34.095436 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:34.096920 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:34.099884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.100439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.100990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.105574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.105901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.106399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.106522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.106838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.107066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.107980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.108513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.109169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.344631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.355813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.372553 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-97fc26b6-17e0-406c-a921-344ca17e3d9b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.284673 Aug 06 01:33:34.381787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 56/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:34 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:34.382465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ff611870-293e-42a5-9713-225dee2c9fc9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.287701 Aug 06 01:33:34.383232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 59/115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:34 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:34.474271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:34.474889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:34.480311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:34.482042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:34.482169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.482610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.484187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.485620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.486697 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.487647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.489180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.489877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.490715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.491242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:34.493354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:34.494131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:34.694772 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.698698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.702151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-54065129-22fa-4d1c-850d-827f5ceb5f8d tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.232566 Aug 06 01:33:34.702728 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 57/116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:34 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:34.707657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.709218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:34.710395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-55aea648-2aa2-4974-88c5-467975d90287 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.235395 Aug 06 01:33:34.710948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 60/117] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:34 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:35.084105 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:35.084719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:35.090628 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.091112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.091547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.092234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.092699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.093149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.156591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.164072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-65291523-6055-4537-a659-453c2f255650 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1218 microversion: 2.1 time: 0.084034 Aug 06 01:33:35.164633 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 58/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:35 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:35.414854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:35.415650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:35.419177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:35.419785 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:35.421691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.422174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.422612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.423300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.423757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.424855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.426558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.427044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.427478 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.428160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.428613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.429034 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.623220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.626270 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.630563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-60134c88-5559-461b-9e76-a4a62ba7fd54 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.219530 Aug 06 01:33:35.631141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 61/119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:35 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:35.634156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e6d30bfa-fec1-439f-9b4a-417ad3ec34c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.218919 Aug 06 01:33:35.634911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 59/120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:35 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:35.724269 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:35.724872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:35.730824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.731305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.731739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.732253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:35.732424 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.732874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.732981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:35.733600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.739798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.740283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.740714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.741439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:35.741893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:35.742315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:35.914857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.923117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.924761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.925956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-22da1f73-77f8-49f0-b8a6-3bcd7008e4be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.197583 Aug 06 01:33:35.926524 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 60/121] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:35 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:35.928449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:35.935932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5020bb62-8937-4adf-8073-e3df4ccfa52e tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.216157 Aug 06 01:33:35.936494 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 62/122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:35 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:36.184972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:36.185729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:36.193250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.193898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.194497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.195510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.196125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.196539 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.258532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:36.265878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-553c6e3b-71d2-49dd-8a0a-4e700af4c9cc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1218 microversion: 2.1 time: 0.084717 Aug 06 01:33:36.266526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 61/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:36 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:36.651919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:36.652513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:36.655534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:36.656164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:36.658528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.659133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.659576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.660281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.660733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.661485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.663378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.663986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.664624 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.665457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.666229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.667141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.872962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:36.875503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:36.883682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8d562770-a165-4390-835b-8050916c8db2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.235474 Aug 06 01:33:36.884537 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 63/124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:36 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:36.884683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-527d7054-c2f0-4e26-9059-dbd38a65e765 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.233633 Aug 06 01:33:36.885586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 62/125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:36 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:36.902063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25b0066-5e40-474a-94a9-d350a71af0ac", "name": "network-vif-plugged", "status": "completed", "tag": "052f72bc-baad-4627-a6fd-ec1944c9e611"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:36.911891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.912366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.912791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.924625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] Creating event network-vif-plugged:052f72bc-baad-4627-a6fd-ec1944c9e611 for instance d25b0066-5e40-474a-94a9-d350a71af0ac on hv-cinder-85200 Aug 06 01:33:36.929560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-136115d9-5ef6-4ab4-9175-7347a0c9c25a req-cf46df6a-72e9-401c-86bd-2481aeb24478 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031166 Aug 06 01:33:36.930157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 64/126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:36.947903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:36.948508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:36.954520 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.955048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.955521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.956207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.956628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:36.956825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.957281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.957623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:36.964157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.964644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.965088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:36.965784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:36.966287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:36.966657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.149985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:37.158701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:37.160247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:37.161379 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-577b12f3-7948-49f8-8fae-cabe8b3a1554 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.217355 Aug 06 01:33:37.162183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 63/127] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:36 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:37.164810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:37.172662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6c5eeed2-bb9c-413b-a0f5-ac3b364646eb tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.220708 Aug 06 01:33:37.173456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 65/128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:36 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:37.287635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:37.288271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:37.294619 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.295094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.295567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.296308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.296815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.297296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.358188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:37.366151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-47e69d54-bfec-47c5-a69b-dcdc674526a1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1218 microversion: 2.1 time: 0.083336 Aug 06 01:33:37.366724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 64/129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:37 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:37.905673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:37.906213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:37.909575 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:37.910274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:37.914521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.915031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.915481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.916446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.916914 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.917375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.919666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.920159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.920594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:37.921318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:37.921784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:37.922234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.114734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.122364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b8c9f75c-8c1b-4c66-9399-955796693a24 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.221346 Aug 06 01:33:38.122933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 66/130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:37 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:38.125834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.134139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-65c45b98-729c-4181-8103-bed78ddb4f15 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.229545 Aug 06 01:33:38.134703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 65/131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:37 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:38.185393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:38.186005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:38.192996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.193507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.193948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.194430 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:38.194772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.195044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:38.195236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.195666 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.201011 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.201522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.201950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.202663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.203115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.203536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.384935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.391752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.393088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.394636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.395812 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d80e0eae-24cc-4b9b-be5e-49a3c985360b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.214337 Aug 06 01:33:38.396374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 67/132] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:38 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:38.400740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-55b3839f-ff64-4c83-ad2c-d9ec98d22510 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.209966 Aug 06 01:33:38.401801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:38.402552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:38.409528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.410211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.410889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.411711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.412267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.412835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:38.417207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:38 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:38.479796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:38.488225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7fa998d6-3664-4b29-83a9-1e90873212ba tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1218 microversion: 2.1 time: 0.090704 Aug 06 01:33:38.488801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 68/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:38 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:38.970044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cee84e-9fda-4bcb-9513-e8b6e343ffaa", "name": "network-vif-plugged", "status": "completed", "tag": "51c934c5-29f0-4f84-b863-02666b538d5b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:38.987516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:38.991364 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:38.992591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.021958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] Creating event network-vif-plugged:51c934c5-29f0-4f84-b863-02666b538d5b for instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa on hv-cinder-85200 Aug 06 01:33:39.034089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-b6596dae-c74c-4615-a43f-820a5292ae12 req-c3632172-f906-44a0-bc17-5d2368aa45f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066615 Aug 06 01:33:39.035269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 67/135] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:39.153979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:39.158643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:39.159004 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:39.159543 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:39.176507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.177064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.177516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.179929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.181511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.182950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.187897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.188432 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.188868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.192238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.192891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.193363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.230069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:39.764830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:39.770414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:39.774397 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8bbedb0d-1580-416f-a114-6a8a682c0683 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.633121 Aug 06 01:33:39.774565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:39.775342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 69/136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:39 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:39.780130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:39.780724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:39.784261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b5705007-ae51-49d2-b9a9-f5bfcf028b1d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.631564 Aug 06 01:33:39.784920 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:39 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:39.786480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.787107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.787675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.788521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.788972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.789414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.789931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:39.790528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:39.796565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.797860 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.798455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:39.799888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:39.800685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:39.800778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.010662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:40.014628 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:40.019956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:40.021754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:40.023091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7bf70ff1-0e90-4333-97e1-b44282d3e9ae tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.246716 Aug 06 01:33:40.023335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-481b35a5-7d9e-4f5d-a988-113f3e29a5b7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.236928 Aug 06 01:33:40.024221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 69/138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:39 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:40.037460 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 70/139] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:39 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:40.044002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:40.044708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:40.052272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.053764 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.054406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.055390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.056087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.056600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.127528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:40.136477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ff4db526-3b54-404d-ae86-0343942e9acf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1266 microversion: 2.1 time: 0.097795 Aug 06 01:33:40.137082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 71/140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:40 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:40.795556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:40.796169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:40.802098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.802585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.803019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.803793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.804331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.804761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.809807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:40.810386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:40.812909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=99 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:40.818025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.818512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.818947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:40.819645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:40.820273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:40.820693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.009155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.012886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.017130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b148676f-9c66-4c49-8c80-dcf390c9cded tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.225351 Aug 06 01:33:41.018241 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:40 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:41.023268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c32a70e9-5aef-4c5d-b50f-eb6a0a6e30c7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.217608 Aug 06 01:33:41.024167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 72/142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:40 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:41.045846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:41.046456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:41.050022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:41.050740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:41.052467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.052953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.053420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.054111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.054568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.054992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.056899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.057417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.057849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.058531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.058987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.059404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.249710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.254535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.257760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-66bab09b-74e8-4ff9-a824-d808376a8d09 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.215656 Aug 06 01:33:41.258634 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 71/143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:41 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:41.263023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.276844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:41.276844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:41.276844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.276844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.277325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.277325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:41.277325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:41.277325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:41.277619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.277619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4754616b-aefd-418c-8048-beadb95f8071 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.229721 Aug 06 01:33:41.277619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 73/144] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:41 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:41.339746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:41.348231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-42dde521-d227-496b-bf09-17bdf0287a3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1266 microversion: 2.1 time: 0.088446 Aug 06 01:33:41.348822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 72/145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:41 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:42.040081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:42.047873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:42.052363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:42.054475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:42.062730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.066603 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.067109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.067553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.068281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.068740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.069201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.073814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.074515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.075261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.075784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.076204 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.280782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.288299 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.295906 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-15891dca-f4ca-4715-ba41-596b9493ec83 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.259744 Aug 06 01:33:42.296415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 74/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:42 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:42.296533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-986b2121-871c-48b6-a5fa-8e919c7023f9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.252419 Aug 06 01:33:42.297007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 73/147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:42 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:42.302212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:42.303120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:42.314970 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.315476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.315911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.316604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.317070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.317491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.317848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:42.318479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:42.326004 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.326495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.326934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.327628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.328084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.328515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.525369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.528541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.534806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.536536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.537166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-21711e56-fb9e-4de7-b723-ed92f3db2175 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.225954 Aug 06 01:33:42.537903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 75/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:42 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:42.538099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4d95552c-5537-4af0-bf57-9953c3311605 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.240112 Aug 06 01:33:42.538602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 74/149] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:42 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:42.543171 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:42.544791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:42.551502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.552523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.553233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.554120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:42.554576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:42.555003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:42.619607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:42.630863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-61aa3e37-f992-48b7-b44c-f04c04c5aa65 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1266 microversion: 2.1 time: 0.091277 Aug 06 01:33:42.631668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 76/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:42 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:43.091086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acdfef-0b50-4561-8f9e-c9159b16d014", "name": "network-vif-plugged", "status": "completed", "tag": "1da54cea-8621-4d67-b9fe-0f749fe8b99d"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:43.101233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.101704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.102144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.114517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] Creating event network-vif-plugged:1da54cea-8621-4d67-b9fe-0f749fe8b99d for instance d7acdfef-0b50-4561-8f9e-c9159b16d014 on hv-cinder-85200 Aug 06 01:33:43.119544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-25a2a2ff-3c10-4c83-9b1e-5fbe4406263c req-82f410d4-edba-46f4-8661-32653a3cbc0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032865 Aug 06 01:33:43.120329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 75/151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:43.317417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:43.318015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:43.318182 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:43.318889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:43.324008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.324426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.324853 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.324994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.325482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.325607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.325917 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.326057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.326477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.326639 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.327092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.327610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.531069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.534460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.539310 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0b7f18ef-ae7a-47e9-8a19-ef0bf0ed4725 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.225817 Aug 06 01:33:43.539891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 77/152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:43 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:43.559273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:43.559875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:43.566364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.566476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-256e4926-41d6-4b12-bc8e-7b3b45f7abf6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.252306 Aug 06 01:33:43.566849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.567279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 76/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:43 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:43.567380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.567959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.568406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.568821 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.571792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:43.572394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:43.580955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.581437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.581875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.582623 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.583143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.583573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.781496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.790825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ea825e5a-2ed0-4fc9-a923-ddaabb8b49a0 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1315 microversion: 2.1 time: 0.235816 Aug 06 01:33:43.792081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 78/154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:43 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:43.802890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:43.803496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:43.811394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.812067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.812982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.813848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:43.815038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:43.815687 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:43.826238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.837139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.838848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.840199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fae6532c-b24b-49d6-9df3-8fbca8acb7eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.271992 Aug 06 01:33:43.859685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 77/155] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:43 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:43.887329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:43.895999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6533c167-8c0b-4fd4-b6be-7b33cd727041 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1274 microversion: 2.1 time: 0.102518 Aug 06 01:33:43.896584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 79/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:43 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:44.561040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:44.561787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:44.568080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.568875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.578749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.581629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.582103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.583217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.583870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.584376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.587881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:44.590141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:44.595471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.601024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.601759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.602202 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.602919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.603501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.604089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.794362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:44.803480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0aaa7bc2-ebb5-484e-920a-312f9b156a88 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1360 microversion: 2.1 time: 0.247213 Aug 06 01:33:44.803648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:44.804060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 78/157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:44 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1360 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:44.812080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-dcc9f9e8-c2f3-41d8-ae26-ff7d5300e697 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.228527 Aug 06 01:33:44.813137 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 80/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:44 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:44.820427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:44.821031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:44.822861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.828793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.829373 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.830416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.831519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.832041 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.832473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.869845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:44.871480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:44.884457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.885393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.886016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:44.888227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:44.889403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:44.890119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.029249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:45.038832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7151e68f-f702-4472-ba74-6cb89a6723e7 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1503 microversion: 2.1 time: 0.225514 Aug 06 01:33:45.053073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 79/159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:44 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:45.053073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:45.053073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:45.058699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.059553 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.060437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.062806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.063501 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.064976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.117797 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:45.134893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:45.138462 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:45.146486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6415bf91-cf56-434b-9eca-50edd450ce68 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.281186 Aug 06 01:33:45.148747 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 81/160] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:44 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:45.162694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "name": "network-vif-plugged", "status": "completed", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:45.178370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.179034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.179634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.211215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] Creating event network-vif-plugged:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:33:45.218264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:45.223120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-c7197e66-185a-41d4-b2e0-d304c10d8769 req-741bb3db-93f4-43ee-9803-710031c6287b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063607 Aug 06 01:33:45.223934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 82/161] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:45.229266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-534db747-b831-4204-ab83-50f06c5aa825 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1274 microversion: 2.1 time: 0.185745 Aug 06 01:33:45.230396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 80/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:45 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:45.825840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:45.827149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:45.833944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:45.834556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:45.835505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.836061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.836708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.837489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.838155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.838661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.841091 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.841657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.842420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:45.843210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:45.843716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:45.844336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.071893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.080256 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-25a7ee28-35a7-494d-9949-fb1b08cca4bd tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.251702 Aug 06 01:33:46.081066 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 81/163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:45 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:46.085157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.090834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-478cd52b-a2d2-4470-a052-a94443a6e6e3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1546 microversion: 2.1 time: 0.269694 Aug 06 01:33:46.091403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 83/164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:45 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:46.113800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:46.114581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:46.120483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.120965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.121427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.122125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.122718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.123119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.173230 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:46.174772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:46.182266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.183307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.184085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.185317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.185857 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.186598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.282009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9cb4a946-4d81-4351-bae0-df9f8832c533 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173005 Aug 06 01:33:46.282686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 82/165] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:33:46 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:46.287961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:46.288561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:46.318854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.319373 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.319840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.320559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.321705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.322137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.467365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.477504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3e700aee-a6a4-4bf1-8422-092260bc0b75 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1272 microversion: 2.1 time: 0.192674 Aug 06 01:33:46.481396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:46 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:46.551589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.572602 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.579955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:46.581017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c493d60c-b1e3-486f-951e-b7b7f75d9560"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:46.582845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c056a606-f1ed-4f32-8560-ea0296f26e57 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.414777 Aug 06 01:33:46.583452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:46.584191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 84/167] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:46 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:46.605292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.606009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.606592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:46.607443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:46.608047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:46.608624 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.101829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:47.103120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:47.110282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.111820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.113003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.113895 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.115037 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.115647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.602825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:47.610143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-372e0aa1-ee9f-4362-9036-597385ce1ca0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.512825 Aug 06 01:33:47.610726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 85/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:47 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:47.630167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:47.630791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:47.638458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.639579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.640275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.641316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.641969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.642767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.770276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:47.773971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.779918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1305ec89-b03b-4882-bafb-e8d1950d1b01 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1272 microversion: 2.1 time: 0.167295 Aug 06 01:33:47.780860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 86/169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:47 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:47.786267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:47.786868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:47.792736 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.793681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.794430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:47.795438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:47.796031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:47.796599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:48.178699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:48.200930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:48.202957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:48.204413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-45dfa719-276f-4a1e-bd65-481eba20fa11 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.422750 Aug 06 01:33:48.206861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 87/170] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:47 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:48.633454 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:48.633965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:48.641378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:48.641378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:48.644290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:48.646470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:48.646962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:48.647403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:48.917162 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:48.932689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a9cb2860-3103-4462-a1d7-cda3b2208901 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.303031 Aug 06 01:33:48.933194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:48 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:48.938387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:48.940363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:48.946935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:48.947564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:48.948156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:48.948866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:48.949358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:48.949787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:49.110093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:49.121526 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d3274a0f-9024-4159-a4c8-32a51c22c104 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.187059 Aug 06 01:33:49.122654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 89/172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:48 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:49.128198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25b0066-5e40-474a-94a9-d350a71af0ac", "tag": "052f72bc-baad-4627-a6fd-ec1944c9e611"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:49.139125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:49.139883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:49.140595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:49.167905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] Creating event network-changed:052f72bc-baad-4627-a6fd-ec1944c9e611 for instance d25b0066-5e40-474a-94a9-d350a71af0ac on hv-cinder-85200 Aug 06 01:33:49.173379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-8c789c7e-5740-42dd-80b0-02afc62c70d8 req-9af20f44-ddef-4906-be37-829864cd9d6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049329 Aug 06 01:33:49.174821 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 90/173] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:49.234431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:49.235112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:49.249153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:49.249845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:49.250275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:49.250984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:49.251435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:49.252531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:49.432662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:49.440674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:49.442229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:49.443459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0adecd76-2eca-49dc-9bd3-4e112ade05c5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.213344 Aug 06 01:33:49.444026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 91/174] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:49 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:49.956267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:49.956676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:49.963420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:49.963915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:49.964346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:49.965357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:49.965961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:49.966686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:50.153116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:50.163502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-78acfbfc-36ce-436d-a992-8b05a89842fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.212048 Aug 06 01:33:50.179660 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:49 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:50.185481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:50.186293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:50.193222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:50.193939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:50.194522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:50.195430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:50.196142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:50.196706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:50.337741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:50.346856 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6be34802-675e-460a-b6f0-01058044755d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.165944 Aug 06 01:33:50.347436 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 93/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:50 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:50.467125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:50.467763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:50.475015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:50.475496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:50.475963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:50.476651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:50.477118 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:50.477541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:50.613364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:50.621606 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:50.623249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:50.624356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-636d7b5e-fa4e-421b-b043-4ce2bb920846 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.161186 Aug 06 01:33:50.625180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 94/177] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:50 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:33:51.190000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:51.191446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:51.213017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.213757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.215489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.216368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.216829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.217296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.241408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e7fac195-9890-4cec-b431-797d27e5bf8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "POST /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.664047 Aug 06 01:33:51.245504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 84/178] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:33:46 2022] POST /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138/os-volume_attachments => generated 194 bytes in 4669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:33:51.368746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:51.369750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:51.379764 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.380258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.390435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.390435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.390435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.390435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.435665 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:51.569404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:51.588281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-64840030-e617-486f-a155-d911f509c68d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.405379 Aug 06 01:33:51.601698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 95/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:51 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:51.646919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:51.647891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:51.656370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.657157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.658935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.659864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.660529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.661185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.796719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:51.807206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6a2a6d05-9285-4325-9fee-015d5fb1408a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.442987 Aug 06 01:33:51.807999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 85/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:51 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:51.940019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af905110-5a0b-4d8e-8916-84750c75856d", "tag": "10a4af4b-557e-4377-980b-7f77339e36cc"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:51.953478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:51.956529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:51.957431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:51.957863 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:51.964103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:51.966128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:51.967506 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f68e7e1a-24b6-4731-90e9-6c881b26e97d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.325209 Aug 06 01:33:51.981456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 96/181] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:51 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:51.991650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] Creating event network-changed:10a4af4b-557e-4377-980b-7f77339e36cc for instance af905110-5a0b-4d8e-8916-84750c75856d on hv-cinder-85200 Aug 06 01:33:51.996668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-a71715e2-a90f-4e38-913f-d9bde5b2c4d2 req-3f08aabe-1713-4c71-9542-0587c9d38ceb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060814 Aug 06 01:33:51.997606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 86/182] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:33:52.611099 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:52.612499 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:52.620749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:52.621279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:52.621710 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:52.622584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:52.623043 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:52.623470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:52.816964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:52.833882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-23ea8385-7f56-4e10-9762-2046a275ac5f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1322 microversion: 2.1 time: 0.226222 Aug 06 01:33:52.835414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 97/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:52 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:52.842561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:52.844071 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:52.859718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:52.860215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:52.860652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:52.861447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:52.861992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:52.862321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:52.993236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:52.993955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:53.005176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:53.006055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:53.006584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:53.007489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:53.008928 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:53.012852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:53.054750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:53.076897 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-112e4597-2bc8-4525-b53a-2ca64afe5371 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.251509 Aug 06 01:33:53.080109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 87/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:52 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:53.258056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:53.272374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:53.274314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:53.275758 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-882f0884-9709-41a0-a5be-b70b7bd55221 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1406 microversion: 2.20 time: 0.286732 Aug 06 01:33:53.276708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 98/185] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:52 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:53.855606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:53.856211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:53.862777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:53.863252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:53.863675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:53.864612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:53.865075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:53.865490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.000033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.008865 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ce5622c8-a338-4b21-9be9-97b31ed007fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1517 microversion: 2.1 time: 0.156674 Aug 06 01:33:54.009671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 88/186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:53 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:54.030605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:54.033696 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:54.040138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.040620 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.041078 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.041761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.042212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.042634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.100683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:54.102288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:54.108144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'flavor' on Instance uuid d7acdfef-0b50-4561-8f9e-c9159b16d014 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:33:54.111942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.112438 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.112871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.113610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.114067 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.125660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.238746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-296c8425-4a99-4697-918a-24d55a6d9edb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014/action" status: 200 len: 32 microversion: 2.1 time: 0.212242 Aug 06 01:33:54.239723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 99/187] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:33:54 2022] POST /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:33:54.260499 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:54.261441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:54.269884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.270605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.272554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.273411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.274227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.274667 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.398843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.432184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0c0ea45a-b910-43c6-a057-ec072e9e9957 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.336427 Aug 06 01:33:54.433676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 89/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:54 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:54.448612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:54.456269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:54.478153 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.478656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.479091 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.480149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.480825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.481599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.492266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.500765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-da65c19c-abd4-4125-92df-ba1b9ad4426a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.254855 Aug 06 01:33:54.503530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 100/189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:54 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:54.683033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.693382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.694894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:54.696320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a2ccf7e0-447e-4121-8977-8605cd1b9557 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1597 microversion: 2.20 time: 0.259493 Aug 06 01:33:54.696953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 90/190] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:33:54 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1597 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:33:54.719366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:54.720038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:54.727034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.727731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.728305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.729194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:54.729790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:54.730365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:54.812960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1b9c43a7-60c8-40c3-8bcf-2adea86a983d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097237 Aug 06 01:33:54.815043 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 101/191] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Aug 6 01:33:54 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:33:55.395850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-401593847", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "networks": [{"uuid": "49f87cbe-59cb-43e3-ac6d-eda0b4e45cf9"}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:55.456736 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:55.458040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:55.475748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:55.476335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:55.476840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:55.477655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:55.478318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:55.478947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:55.486179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] validate_networks() for [('49f87cbe-59cb-43e3-ac6d-eda0b4e45cf9', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:33:55.509458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:56.272578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:56.279922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8c3595c6-c5c3-4ff0-a771-8c762c92202f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.827981 Aug 06 01:33:56.293787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 102/192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:55 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:33:56.293787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:56.293787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:56.296204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:56.296763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:56.297226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:56.297919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:56.298969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:56.299600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:56.797625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:56.806116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-68dbaa9e-9978-431a-b07a-9d05352a7fdb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.520325 Aug 06 01:33:56.806942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 103/193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:56 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:57.142359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:33:57.143407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:33:57.144309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:33:57.144586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:33:57.145618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:33:57.156033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.156687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.157487 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.158946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.159715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.160465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.178976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Getting quotas for project e50641dc16fa4187b5f0d4f936d34d53. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:33:57.183024 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Getting quotas for user c938a575a2704078a82fe6df941884dc and project e50641dc16fa4187b5f0d4f936d34d53. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:33:57.194660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:33:57.196936 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:33:57.247670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6cf04455-f786-43f2-a176-0c666bf4efc2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858389 Aug 06 01:33:57.248486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 91/194] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:33:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:33:57.259785 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:33:57.261079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e01f0598-ebab-476e-b992-e23569a944fd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:57.261891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e01f0598-ebab-476e-b992-e23569a944fd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:57.321417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e01f0598-ebab-476e-b992-e23569a944fd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:57.335672 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e01f0598-ebab-476e-b992-e23569a944fd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1218 microversion: 2.1 time: 0.078440 Aug 06 01:33:57.336453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 92/195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:57 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:57.348932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.351861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.354500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.360707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:57.363853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:57.382327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.383008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] Creating event network-changed:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:33:57.383440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.384297 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.386015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.386732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.387303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.400569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-4f604a10-fdfd-4a1b-8dc4-77a304b2173f req-6f328435-bfe0-4993-8983-bf75b8827901 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144284 Aug 06 01:33:57.402298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 104/196] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:33:57.586586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:57.598605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4e6bee74-0fc5-4243-9a7d-21487b4c47e0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.246937 Aug 06 01:33:57.601433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 93/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:57 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:57.828534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:57.830330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:57.837735 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.839030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.839786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:57.840861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:57.841648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:57.842288 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:58.030650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:58.039877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fac7dcf2-a6ac-45c9-9d27-2b1ae01863d2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.215909 Aug 06 01:33:58.054231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 105/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:57 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:58.358812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:58.359725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:58.367251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:58.367862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:58.368394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:58.369329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:58.369962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:58.370447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:58.460590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:58.469116 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c9f6b96f-85c5-4d3c-82ec-80571fd55518 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1222 microversion: 2.1 time: 0.114701 Aug 06 01:33:58.481956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 94/199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:58 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:58.623797 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:58.624410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:58.633977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:58.634462 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:58.634899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:58.635592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:58.636051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:58.636470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:58.861680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:58.874398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1becff43-fc9f-408a-84c6-596b34705aa5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.250952 Aug 06 01:33:58.875326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 106/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:58 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:59.061913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:59.062707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:59.073999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.074503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.076719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:59.077480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.078815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.081091 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:59.474882 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:59.490417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dd8513a2-e87e-458e-b636-7edb69eb246a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.432673 Aug 06 01:33:59.491327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 95/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:59 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:59.497179 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:59.498141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:59.510333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.511097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.511683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:59.512535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.514015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.514900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:59.614525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:33:59.624268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8f9b194f-f382-4e49-b288-6b20de168ee3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1270 microversion: 2.1 time: 0.135218 Aug 06 01:33:59.624738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 107/202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:59 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:33:59.896939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:33:59.899010 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:33:59.905285 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.906010 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.906544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:33:59.907309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:33:59.908507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:33:59.909185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:00.088414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:00.099829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b9a93cba-6a2f-49fb-a16b-1597e28a180b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.208035 Aug 06 01:34:00.101239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 96/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:33:59 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:00.514013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:00.515284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:00.521668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:00.522155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:00.522589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:00.523275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:00.523726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:00.524149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:00.645902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:00.647129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:00.655501 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:00.656330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:00.656928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:00.657981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:00.658587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:00.659157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:00.991961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:01.000585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-14c59f8f-cccb-47b2-8fa5-d4e3d8649787 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1288 microversion: 2.1 time: 0.358695 Aug 06 01:34:01.001200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 97/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:00 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1288 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:01.046327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:01.055266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a790ff15-6344-4ffb-a6b5-bbaca4a996f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.546326 Aug 06 01:34:01.055860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 108/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:00 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:01.123199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:01.124098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:01.147437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:01.148431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:01.149085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:01.152585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:01.153379 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:01.154065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:01.354419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:01.362080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-998a3309-dd18-483a-8d8f-dc5838e26527 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.243471 Aug 06 01:34:01.362734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 98/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:01 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:02.023240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:02.024010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:02.030740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.031337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.031665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.032370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.033428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.033885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.075888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:02.077241 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:02.084084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.084797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.085194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.085886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.086334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.086857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.230454 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:02.240099 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-de6f96a7-e204-405b-b745-8bb47e9b9bda tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.220740 Aug 06 01:34:02.241245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 109/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:02 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:02.258876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:02.266437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f0ede0e4-c50e-4ea6-b230-5d7f965ffbae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.194671 Aug 06 01:34:02.267508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 99/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:02 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:02.383484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:02.384021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:02.390113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.390589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.391022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.391702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.392152 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.392570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.536070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:02.544280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-aba4a267-a23f-40ed-865b-afa5ab52b7bc tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.164692 Aug 06 01:34:02.544836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 110/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:02 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:02.709427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af905110-5a0b-4d8e-8916-84750c75856d", "name": "network-vif-plugged", "status": "completed", "tag": "10a4af4b-557e-4377-980b-7f77339e36cc"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:02.725354 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:02.726062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:02.726784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:02.739554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] Creating event network-vif-plugged:10a4af4b-557e-4377-980b-7f77339e36cc for instance af905110-5a0b-4d8e-8916-84750c75856d on hv-cinder-85200 Aug 06 01:34:02.745583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-9f1aec94-6001-49aa-8d15-b06fa726ea2c req-3541e912-df0c-4a68-a273-d53ebd2d2874 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040837 Aug 06 01:34:02.746661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 100/210] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:03.262264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:03.263008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:03.269957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.270447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.270878 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.271569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.272068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.273320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.291921 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:03.293515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:03.303252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.303839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.304489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.305568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.306224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.307404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.662115 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:03.670295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f229d209-9192-4340-9f86-26fd94f95d99 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.411906 Aug 06 01:34:03.671668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 111/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:03 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:03.676963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:03.677854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:03.684645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.685410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.685973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.686654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:03.687317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:03.687737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:03.769735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:03.777553 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b4433d8f-3d8f-4f4b-9568-c2c7358ac028 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.491389 Aug 06 01:34:03.778132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 101/212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:03 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:03.914670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:03.923269 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9d528225-e821-45b6-b209-e46b07feca74 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.250275 Aug 06 01:34:03.936668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 112/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:03 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:04.176446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b150724-1383-42cb-8f3c-b93cf6978ed2", "tag": "196e367b-8037-4328-8e2d-49d83b53c6bf"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:04.190404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.191229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.192116 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.206083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] Creating event network-changed:196e367b-8037-4328-8e2d-49d83b53c6bf for instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 on hv-cinder-85200 Aug 06 01:34:04.211743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-a4868694-d63d-437f-bc88-b4df31b123e5 req-dc8127e7-cd87-4f2c-9ba6-bb8991a7b65b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040352 Aug 06 01:34:04.212992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 102/214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:04.693003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:04.693973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:04.699733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.700213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.700640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.701357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.701805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.702223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.802391 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:04.805663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:04.823248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.823969 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.824951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.826135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.826834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.827671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.928390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:04.947876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b0c5b899-22a6-4ace-98bd-ca80a247a0fc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.258263 Aug 06 01:34:04.949703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 113/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:04 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:04.955494 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:04.956550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:04.964149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.965080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.967036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:04.967972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:04.968937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:04.971468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.006174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:05.014967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cf76b310-bad7-4c96-a181-a8a23e8e2608 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.219377 Aug 06 01:34:05.015673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 103/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:04 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:05.156303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:05.168122 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0cfc557e-84cb-4893-8da2-7e4bd7cf2ff3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.216256 Aug 06 01:34:05.168794 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 114/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:04 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:05.326988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:05.327579 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:05.334336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.334915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.335347 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.336046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.336493 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.336911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.362237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:34:05.391627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:05.463936 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6fd8e18c-2560-4470-aa76-8804ee9ce1fc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 204 len: 0 microversion: 2.1 time: 0.141067 Aug 06 01:34:05.464610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 104/218] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:34:05 2022] DELETE /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:34:05.472818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:05.473469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:05.479506 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.479988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.480466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.481209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.481657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.482074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.650919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:05.660168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-46ebb71a-b528-458a-b50e-ddd41e19a975 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.191218 Aug 06 01:34:05.660827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 115/219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:05 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:05.971492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:05.972188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:05.979540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.980026 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.980461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:05.981179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:05.981635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:05.982059 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.037155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:06.037763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:06.051727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.052074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.052772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.053716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.054543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.054980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.209448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:06.221490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9300ae16-26b6-49b5-b626-3ebf281824c3 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.253770 Aug 06 01:34:06.234791 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 105/220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:05 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:06.238028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:06.241674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:06.242355 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:06.248873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.248998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-934a6b5b-5ed5-4d90-8daf-df856143d13d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.215329 Aug 06 01:34:06.249539 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.249835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 116/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:06 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:06.250176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.250948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.251445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.251902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.440141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:06.450864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b619223a-64ba-4a87-ab9d-6d3bdcd10d79 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.214327 Aug 06 01:34:06.452002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 106/222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:06 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:06.681221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:06.681832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:06.687871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.688351 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.689431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.690138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:06.690602 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:06.691026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:06.822023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:06.831689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d152e6f1-0969-49bc-a6e3-02aa460e0ea6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.154285 Aug 06 01:34:06.832345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 117/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:06 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:07.244325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:07.244943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:07.247342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.252682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.253324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.253832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.254596 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.255126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.255616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.270572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:07.271177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:07.277267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.278020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.278558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.279324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.279844 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.280344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.327390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=8 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.455376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:07.465087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4ca2c835-1e57-410b-a039-3dbdcab1b467 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.224475 Aug 06 01:34:07.466064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 107/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:07 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:07.474323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:07.475656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:07.483919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.484072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:07.484613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.485289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.487052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.487894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.488530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.492941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e8012548-083b-495c-8d60-c650556c2b36 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.227230 Aug 06 01:34:07.493559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 118/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:07 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:07.639783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:07.649322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-31e0c0bb-6221-486a-b0fb-dc48fea03873 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.178744 Aug 06 01:34:07.649322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 108/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:07 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:07.852084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:07.852685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:07.858631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.859106 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.859534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.860205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:07.861329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:07.861787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:07.991011 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:07.994701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:08.000725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9e89fe53-5654-4403-8763-39bb60c02e27 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.152377 Aug 06 01:34:08.001549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 119/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:07 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:08.487142 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:08.487741 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:08.494584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.495109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.495544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.496267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.496781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.497258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.514689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:08.515827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:08.522327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.522818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.523258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.523954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.524412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.524835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.697525 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:08.700664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:08.706239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ea4ab068-a504-4d3d-a6c6-6e0e6863342d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.222870 Aug 06 01:34:08.706898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 109/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:08 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:08.708975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c3a72469-c966-4d76-bb79-5569c343c336 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.198464 Aug 06 01:34:08.709608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 120/229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:08 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:08.711577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:08.712187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:08.718226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.718783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.719290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.720049 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:08.720515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:08.721020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:08.846701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:08.854062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dd00340e-8909-45b3-8e9a-4897b4c66105 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.146164 Aug 06 01:34:08.854636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 110/230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:08 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:09.021521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:09.022129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:09.028023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.028538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.028974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.029679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.030132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.030557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.162792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:09.170765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e0bce31-c315-41f9-bd70-8a675dcc1fcd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.153088 Aug 06 01:34:09.171337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 121/231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:09 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:09.727299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:09.727987 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:09.730135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:09.730570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:09.732426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:09.735074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.735856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.736397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.737463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.737924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.738353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.738510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.738984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.739689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.740380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.740835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.741408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.929136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:09.932368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:09.936663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c9491b34-c080-4231-9285-784812509819 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.213507 Aug 06 01:34:09.937348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 111/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:09 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:09.940479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a0a704f5-4847-4b2a-b6aa-5220fce2b2d0 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.214286 Aug 06 01:34:09.941066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 122/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:09 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:09.942672 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:09.943274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:09.948901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.949574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.950009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:09.950693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:09.951144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:09.951563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.081243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:10.088514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-43523489-e3b6-43ca-b39d-228abeacfcd9 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1314 microversion: 2.1 time: 0.149980 Aug 06 01:34:10.089106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 112/234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:09 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:10.192718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:10.193351 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:10.199248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.199734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.200168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.200856 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.201340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.201766 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.327692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:10.336597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ccbc871b-5f9f-4662-b9eb-0107c981b2cc tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.148313 Aug 06 01:34:10.337190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 123/235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:10 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:10.959259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:10.960213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:10.961915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:10.963012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:10.966678 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.967164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.967591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.968282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.968900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.969032 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.969402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.969507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.969852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:10.970556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:10.971097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:10.971525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:11.164834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:11.171567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:11.172525 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-67cf510e-7657-4340-9079-910917aa9706 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.218524 Aug 06 01:34:11.173131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 113/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:10 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:11.178946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:11.179557 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:11.180263 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-902abe1a-89f7-4585-ae17-ece33423421b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.222502 Aug 06 01:34:11.180836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 124/237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:10 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:11.185867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:11.186353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:11.186856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:11.187545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:11.187999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:11.188419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:11.337415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:11.344808 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d8b0e004-8014-4bb0-a349-64a2ccd1d8df tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1498 microversion: 2.1 time: 0.170005 Aug 06 01:34:11.345430 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 114/238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:11 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:11.358400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:11.359044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:11.365966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:11.366457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:11.366892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:11.367619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:11.368072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:11.368501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:11.506703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:11.514953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c405b22b-8e9e-4e81-8cb0-baa2798eb59b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.160552 Aug 06 01:34:11.515527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 125/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:11 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:12.171550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:12.172027 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:12.178917 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.179394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.179824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.180499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.180947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.181390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.194269 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:12.194904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:12.200814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.201384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.201818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.202536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.202989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.203411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.209262 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:34:12.280150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:12.287660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6e1643c4-0953-44ed-93dd-65f78e573f3b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 204 len: 0 microversion: 2.1 time: 0.119894 Aug 06 01:34:12.288643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 115/240] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:34:12 2022] DELETE /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:34:12.293715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:12.294413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:12.301127 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.301620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.302057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.302746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.303198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.303617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.337820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:12.345445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ce4825f5-9d72-440b-b9b4-320c7797f495 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.154967 Aug 06 01:34:12.346321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 126/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:12 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:12.352446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:12.353068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:12.358881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.359359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.359786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.360514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.360910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.361408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.492680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:12.500155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7898d51f-0afe-4abf-9845-1ee2a735483f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.210553 Aug 06 01:34:12.500736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 116/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:12 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:12.522133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:12.529557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8932503b-631f-4be6-bb3d-984b88400ae1 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.182145 Aug 06 01:34:12.530126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 127/243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:12 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:12.541280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:12.541280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:12.542238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.542747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.543183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.543881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:12.544330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:12.544751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:12.671870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:12.680516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4758b8cb-2b2b-44d0-85f4-69584e6e224c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.148528 Aug 06 01:34:12.681112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 117/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:12 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:13.366187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:13.366831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:13.372850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.373443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.373882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.374576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.375031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.375459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.507179 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:13.514714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-43f62f6e-766b-49af-8712-a1f2703b3274 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.153437 Aug 06 01:34:13.515290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 128/245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:13 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:13.521323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:13.521939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:13.527990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.528471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.528905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.529617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.530068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.530490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.550530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:13.551140 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:13.556948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.557467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.557902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.558591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.559078 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.559510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.725963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:13.729335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:13.732731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:13.734698 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-23f31f4e-8428-48a7-889d-eaf565658aa7 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.217326 Aug 06 01:34:13.735280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 118/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:13 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:13.740779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:13.741401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:13.741511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ed26e14a-9a9c-4648-835e-6ededa9c8f9e tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.195137 Aug 06 01:34:13.742336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 129/247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:13 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:13.748278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.748814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.749271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.749953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:13.750399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:13.750813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:13.878548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:13.886521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ff54e7e3-af46-4154-aacf-b822ed2959a8 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.150310 Aug 06 01:34:13.887077 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 119/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:13 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:14.534960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:14.535576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:14.541554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.542038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.542474 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.543159 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.543618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.544041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.669714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:14.677147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4beccb2f-5454-43f7-89fd-3a3af83aa08c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.146208 Aug 06 01:34:14.677717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 130/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:14 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:14.757235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:14.757920 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:14.762605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:14.763218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:14.764312 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.764793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.765318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.766005 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.766452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.766864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.769165 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.769653 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.770087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.770776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.771230 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.771652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.968562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:14.972913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:14.976857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f2ebf0f3-2b47-4a80-963e-2a6ab7e8acc8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.223577 Aug 06 01:34:14.977476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 120/250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:14 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:14.980258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bbf1b1b0-d578-4105-a452-02269317bce3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.221378 Aug 06 01:34:14.980971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 131/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:14 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:14.981981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:14.982590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:14.988289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.988804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.989334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:14.990290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:14.990745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:14.991168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:15.121277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:15.129780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-92279446-1a1b-4278-878c-bd04e3a80883 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.151351 Aug 06 01:34:15.130393 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 121/252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:14 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:15.698040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:15.698648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:15.704592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:15.706378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:15.706810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:15.707490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:15.707936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:15.708350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:15.834417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:15.841833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d25975e6-2c01-48f5-9832-18717bb75350 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.147646 Aug 06 01:34:15.842411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 132/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:15 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:15.998015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:15.998536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:16.000816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:16.001451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:16.005801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.006338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.006753 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.007441 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.007706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.007897 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.008191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.008318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.008628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.009343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.009803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.010240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.205688 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:16.209590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:16.213430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6435fe90-ec71-4efd-a330-ce3c3aa08cca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.216327 Aug 06 01:34:16.214000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 133/254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:15 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:16.217290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-131e4e47-efe8-44be-8d59-a720f367e11a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.223146 Aug 06 01:34:16.217849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 122/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:15 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:16.218473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:16.219170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:16.225465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.225948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.226379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.227062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.227512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.227933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.357832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:16.366310 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-45b781ab-8874-43a8-88b7-b7862b7e5323 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.151387 Aug 06 01:34:16.366876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 134/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:16 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:16.863443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:16.863547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:16.869820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.870305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.870741 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.871435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.871896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.872323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.976276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c798285-436b-4040-90b1-6228ed48a138", "name": "network-vif-unplugged", "status": "completed", "tag": "73adc3cd-6972-476a-a899-95cebd699ff5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:16.986650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:16.986650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:16.987166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:16.999129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] Creating event network-vif-unplugged:73adc3cd-6972-476a-a899-95cebd699ff5 for instance 8c798285-436b-4040-90b1-6228ed48a138 on hv-cinder-85200 Aug 06 01:34:17.004707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-c6a7cf5b-d4ff-483a-aa2e-6411f92aa6ba req-646f8c1e-361b-453a-bb7b-7dd348f2a282 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032735 Aug 06 01:34:17.005513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 135/257] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:34:17.014481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:17.022435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-95840af0-b5c9-4537-bfcd-57bab906d4a7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.163540 Aug 06 01:34:17.023194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 123/258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:16 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:17.235363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:17.236088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:17.238215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:17.238822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:17.242489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.242978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.243413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.244098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.244550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.244752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.244972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.245282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.245712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.246387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.246836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.247258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.439788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:17.444217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:17.447725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b961a9d5-6b46-44e4-9302-0649f9696663 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.216555 Aug 06 01:34:17.448309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 136/259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:17 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:17.451893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a3b93402-2c70-47c4-a999-1b1640e05145 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.217750 Aug 06 01:34:17.452789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:17.453418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:17.456306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 124/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:17 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:17.459400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.459880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.460309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.460990 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:17.461470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:17.461892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:17.465967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:17.589150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:17.597787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ebdb08bb-71cf-438d-a18c-94eae9a97fed tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.148542 Aug 06 01:34:17.598363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 137/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:17 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:18.044146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:18.044841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:18.056823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.056823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.056823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.056823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.057152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.057152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.187149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:18.196220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-14a5efbe-75b4-4fdb-8cc1-f7ae9ed00f2f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.156185 Aug 06 01:34:18.196829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 125/262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:18 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:18.468354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:18.469070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:18.471515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:18.472127 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:18.475208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.475691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.476124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.476815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.477301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.477723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.477934 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.478419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.478863 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.479548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.480012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.480438 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.672636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:18.676279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:18.681091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1f4ac8eb-a902-4ac4-b468-89e65d1cdae6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.216592 Aug 06 01:34:18.681664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 138/263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:18 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:18.683687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e4486e20-0f57-4a7c-b5bf-81bccb50c97f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.216024 Aug 06 01:34:18.684253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 126/264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:18 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:18.686406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:18.686988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:18.693740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.694215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.694646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.695326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:18.695774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:18.696191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:18.827161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:18.835648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0ab101a5-1e58-47c8-820b-772658619e52 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.152920 Aug 06 01:34:18.836224 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 139/265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:18 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:19.217443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:19.218047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:19.224344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.225142 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.225301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.225979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.226426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.226846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.353349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:19.360719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5b744244-b7d4-4465-9d08-53d27492a307 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.147067 Aug 06 01:34:19.361838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 127/266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:19 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:19.701882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:19.702491 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:19.704820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:19.705457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:19.710600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.711095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.711288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.711534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.711773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.712208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.712315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.712671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.712895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.713119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.713390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.713818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.902738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:19.910728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-98358c8c-9d4e-487e-97c8-ece95aab63e6 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.212805 Aug 06 01:34:19.911327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 140/267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:19 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:19.914101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:19.916540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:19.917185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:19.922120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0c9ecaa5-6d4a-455f-8711-6dfe125da3ef tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.221108 Aug 06 01:34:19.922950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 128/268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:19 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:19.923077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.923364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.924558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:19.925257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:19.925719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:19.926155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.055909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:20.063816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b37f21a4-5472-4c28-9a8e-e292919b701c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.150857 Aug 06 01:34:20.064415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 141/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:19 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:20.382756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:20.383361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:20.389738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.390216 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.390675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.391358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.391810 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.393037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.520671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:20.527929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d1fb7a08-878f-472f-a20b-661576c5af4b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.148940 Aug 06 01:34:20.528493 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 129/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:20 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:20.932010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:20.932543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:20.938453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.938933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.940084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.940765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.941249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.941666 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.943968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:20.944573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:20.953839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.954338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.954817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:20.955752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:20.956216 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:20.956644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:21.097272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:21.104920 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-eb140eb4-5bd3-4679-84c0-ef174297161c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.165785 Aug 06 01:34:21.105736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 130/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:20 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:21.110245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:21.110854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:21.117754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:21.118243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:21.118679 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:21.119411 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:21.119866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:21.120304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:21.261306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:21.269894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d3081647-2669-4587-b871-56fbe2408610 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.341725 Aug 06 01:34:21.270490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 142/272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:20 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:21.287834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:21.295987 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-25e6fbec-1d5d-4f6c-8d58-52c1b648d1de tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.189522 Aug 06 01:34:21.296561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 131/273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:21 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:21.548819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:21.549481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:21.555359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:21.555839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:21.556270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:21.556952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:21.557427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:21.557850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:21.687440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:21.694829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-94c2f208-797b-4608-876f-65d515e347e4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.150026 Aug 06 01:34:21.695401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 143/274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:21 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:22.128307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:22.128991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:22.135385 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.135870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.136334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.137019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.137500 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.137924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.293273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:22.293786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:22.300580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.301089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.301531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.302221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.302677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.303102 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.462959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:22.471383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-87d95d73-18f9-4f23-9269-261b57d478ee tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.346929 Aug 06 01:34:22.471978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 132/275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:22 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:22.485439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:22.488121 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:22.488865 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:22.493704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-94cf19e3-3d25-4316-b541-b0d661b42478 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.204350 Aug 06 01:34:22.494318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 144/276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:22 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:22.495209 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.495703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.496141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.496837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.497386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.497814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.627802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:22.635734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b15b8101-eb71-4c08-ac26-bc4b5b692a0a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.162813 Aug 06 01:34:22.636293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 133/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:22 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:22.715696 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:22.716307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:22.722440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.722925 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.723370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.724059 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:22.724514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:22.724941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:22.851348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:22.858669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4345c8fa-a29b-4cb6-980d-ab880a61a3f5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.146848 Aug 06 01:34:22.859229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 145/278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:22 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:23.492606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:23.493262 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:23.500608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.501313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.502280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.502971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.503425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.503874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.515413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:23.516142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:23.522795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.523487 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.523930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.525732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.526213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.526645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.700132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:23.708627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-22c3de94-8c81-4a71-a8a2-6c119d4fd50d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.220140 Aug 06 01:34:23.709332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 134/279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:23 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:23.714109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:23.714945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:23.723130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:23.728290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.728788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.729436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.730306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.730762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.730992 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d39d299b-412f-45d5-97b7-fc2a05657134 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.220021 Aug 06 01:34:23.731363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.731692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 146/280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:23 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:23.751310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:23.869420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:23.878372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cfc7b3cb-04c7-40bd-8e21-a5943ae90ecd tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.167850 Aug 06 01:34:23.879072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 135/281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:23 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:23.879633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:23.880246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:23.886688 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.887086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.887523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:23.888216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:23.888670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:23.889110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.029036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:24.037206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-449997d4-bb9c-4558-8067-835d40e3d230 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.161323 Aug 06 01:34:24.037763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 147/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:23 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:24.732005 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:24.732610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:24.739891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.740376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.740809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.741521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.741975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.742396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.752777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:24.753426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:24.759363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.759844 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.760278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.760969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.761451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.761876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.931966 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:24.938567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:24.939732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cb20e472-f422-4b8e-b167-cb553db2ba33 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.211168 Aug 06 01:34:24.939982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 136/283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:24 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:24.944363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:24.944968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:24.946149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6fdd1c39-7b17-4496-aa43-9debae933015 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.197790 Aug 06 01:34:24.946706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 148/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:24 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:24.950608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.951096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.951528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:24.952210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:24.952778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:24.953237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.057513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:25.058222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:25.064518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.065109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.065552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.066242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.066692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.067113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.084983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:25.092825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b0d7c4b3-e8e3-438c-adfa-037d452737d5 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.151899 Aug 06 01:34:25.093440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 137/285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:24 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:25.194626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:25.201969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5cdbcb02-a6ee-41b0-9a37-abaca44193db tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.148322 Aug 06 01:34:25.202528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 149/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:25 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:25.960342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:25.960988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:25.967092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:25.967558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.967700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:25.967851 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.968284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.968980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.969458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.969883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.974370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.974854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.975292 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:25.975980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:25.976435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:25.976855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:26.162648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:26.169275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:26.170531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e3dd1bc7-a5d4-44ad-b612-fb477d5e85ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.213972 Aug 06 01:34:26.171219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 138/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:25 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:26.176791 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:26.177569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e1b7beb-4877-4acd-be5d-c765a80366bb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.214235 Aug 06 01:34:26.177717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:26.178134 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 150/288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:25 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:26.183609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:26.184198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:26.184831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:26.185604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:26.186131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:26.186611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:26.223226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:26.223755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:26.231410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:26.231973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:26.232564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:26.233322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:26.233774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:26.234196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:26.367861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:26.375716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2f6da22a-80be-4a38-9c78-d1131a3ae311 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.203497 Aug 06 01:34:26.376282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 139/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:26 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:26.393947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:26.401306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bf0a0a58-9606-4866-a989-2b557f5728bf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.181979 Aug 06 01:34:26.401872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 151/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:26 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:27.192095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:27.192712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:27.199011 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:27.199454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.199622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:27.199797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.200234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.200930 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.201413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.201838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.205964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.206440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.206873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.207563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.208016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.208449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.394145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:27.401618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:27.401768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-31928896-6832-4c85-a3f4-dce367dc0f83 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.213891 Aug 06 01:34:27.402416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 140/291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:27 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:27.406741 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:27.407339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:27.414147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.414688 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.415046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.415775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.416233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.416651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.420788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5c46aa33-2f9f-4558-925b-187de0d53187 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.225477 Aug 06 01:34:27.421405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 152/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:27 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:27.426654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:27.427265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:27.432892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.433538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.433976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.434664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:27.435111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:27.435534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:27.599645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:27.607460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-65075cff-3530-4e2e-bd42-8fb77519ffb6 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.204228 Aug 06 01:34:27.608023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 141/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:27 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:27.624677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:27.628421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:27.633213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-708a933b-93d0-4f86-823f-ad3fb088cefa tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.210829 Aug 06 01:34:27.633771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 153/294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:27 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:28.422739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:28.423350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:28.429974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.430466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.431051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.431573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.432022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.432440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.443117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:28.444388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:28.450913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.451588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.452028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.452732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.453229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.453917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.618897 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:28.630962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-be875315-7fda-4135-a1a9-ae3b0f5a0e8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.211369 Aug 06 01:34:28.631157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 142/295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:28 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:28.635812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:28.636493 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:28.643926 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.644543 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.645065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.645761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.646224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.646650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.663003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:28.671080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d67939a9-c26c-4cf0-8520-2fc2de2d6e3d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.232214 Aug 06 01:34:28.672033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 154/296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:28 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:28.677520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:28.678196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:28.684751 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.685503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.686151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.686943 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:28.687586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:28.688077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:28.826639 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:28.836122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-68359622-f101-4d54-9f16-547b97a8c647 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.203978 Aug 06 01:34:28.836702 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 143/297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:28 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:28.865447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:28.873105 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-046e99f3-666f-4402-b482-1b7832692cbc tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.199867 Aug 06 01:34:28.873654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 155/298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:28 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:29.653561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:29.654183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:29.661794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.662409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.663007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.664905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.665556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.666009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.698233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:29.699176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:29.705777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.706657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.707296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.708304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.709988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.710611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.869737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:29.878691 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5e0312a1-a779-485c-87e8-a37d421ac9cb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.230198 Aug 06 01:34:29.879897 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 144/299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:29 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:29.892900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:29.894151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:29.901257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.901257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.901456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.901838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:29.902123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.902581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.903006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.910374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6d8381f1-819f-45d3-a3aa-475fb2e66d7a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.216449 Aug 06 01:34:29.910865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 156/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:29 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:29.915588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:29.916772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:29.924147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.925320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.925869 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:29.926631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:29.927150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:29.927638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:30.106904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:30.110744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:30.115522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-df0be69e-9421-4b27-b03a-fd4ae7881df1 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.234529 Aug 06 01:34:30.116108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 145/301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:29 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:30.118889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c6701b97-2e2a-47af-b986-439b6cc18ea5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.206851 Aug 06 01:34:30.119455 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 157/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:29 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:30.902072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:30.903447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:30.912168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:30.912620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:30.913087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:30.913992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:30.914616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:30.915044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:30.935278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:30.938759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:30.945393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:30.946196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:30.946830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:30.947726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:30.949017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:30.949664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:31.590701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:31.601005 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a7ece2c2-d440-435e-b0bd-8f21434d2839 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.702807 Aug 06 01:34:31.601489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:31.613593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e9bd073-e6c6-40d1-bb0b-849da384c699 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1504 microversion: 2.1 time: 0.685011 Aug 06 01:34:31.614909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 158/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:30 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1504 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:31.616068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 146/304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:30 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:31.621983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:31.622608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:31.623899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:31.624929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:31.630145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:31.630636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:31.631069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:31.631755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:31.632506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:31.633297 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:31.634789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:31.635403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:31.636012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:31.636928 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:31.637986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:31.638772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.064369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:32.067505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:32.075327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b11e6087-f8d6-4153-b354-6dd8f366901a tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1555 microversion: 2.1 time: 0.458728 Aug 06 01:34:32.076215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 159/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:31 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:32.077530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-21ec4510-2c7c-4366-92ca-cff8763a7cbf tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.460002 Aug 06 01:34:32.078628 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 147/306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:31 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:32.287659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c798285-436b-4040-90b1-6228ed48a138", "name": "network-vif-deleted", "tag": "73adc3cd-6972-476a-a899-95cebd699ff5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:32.303673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:32.305855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:32.307721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.324311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] Creating event network-vif-deleted:73adc3cd-6972-476a-a899-95cebd699ff5 for instance 8c798285-436b-4040-90b1-6228ed48a138 on hv-cinder-85200 Aug 06 01:34:32.329678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-05b94562-cbbd-4e64-b705-e94aae37982c req-40bfb5bf-464e-4734-868c-d62e3afffd77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046654 Aug 06 01:34:32.330581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 160/307] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:32.623094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:32.623701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:32.630616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:32.631097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:32.631536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.632260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:32.632714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:32.633355 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.638984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:32.640041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:32.647202 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:32.647780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:32.648328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.649285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:32.649727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:32.650221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:32.741641 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:32.750624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-44bbcf93-8ed3-4495-b66f-074ebbf9fe14 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1462 microversion: 2.1 time: 0.115531 Aug 06 01:34:32.751411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 161/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:32 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1462 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:32.803979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:32.812056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c5604ce4-e618-4d79-9711-d4890f24d023 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.192961 Aug 06 01:34:32.812629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 148/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:32 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:33.097622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:33.098236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:33.104347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.104839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.105310 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.106012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.106513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.106882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.112885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:33.113635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:33.120611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.121227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.121737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.122507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.123036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.123534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.183112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:33.192447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c2b83c61-f017-421c-9c4a-1447605c9905 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1513 microversion: 2.1 time: 0.098714 Aug 06 01:34:33.205583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 162/310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:33 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1513 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:33.289244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:33.298530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6d843546-da69-4bdc-b83f-22cbee0bb194 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.189817 Aug 06 01:34:33.299394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 149/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:33 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:33.775464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:33.776459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:33.783302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.784588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.785288 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.786228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.786890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.787521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.839417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:33.842022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:33.859376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.859864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.860302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.860999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:33.861496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:33.861884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:33.888166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:33.896781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ca6b5b52-00da-41c1-9055-a37d98686460 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1462 microversion: 2.1 time: 0.126673 Aug 06 01:34:33.897388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 163/312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:33 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:34.034171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:34.046625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f6c6f13c-1b1d-4e6d-ac1f-7537c85ab32d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.214177 Aug 06 01:34:34.055725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 150/313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:33 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:34.213157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:34.213923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:34.224905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.228314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.228759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.230746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.231218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.232837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.324609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:34.325730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:34.335205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:34.338715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.339103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.339560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.340174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.340627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.341027 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.349376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-158039e3-3868-4488-abae-baf24db36c8b tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1346 microversion: 2.1 time: 0.140087 Aug 06 01:34:34.350210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 164/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:34 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:34.357728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af905110-5a0b-4d8e-8916-84750c75856d", "name": "network-vif-deleted", "tag": "10a4af4b-557e-4377-980b-7f77339e36cc"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:34.368554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.368960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.369427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.380768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] Creating event network-vif-deleted:10a4af4b-557e-4377-980b-7f77339e36cc for instance af905110-5a0b-4d8e-8916-84750c75856d on hv-cinder-85200 Aug 06 01:34:34.385749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-3c1309a2-acd3-4392-a09f-7959c6abe7a3 req-7c566540-5f03-472a-ab97-7afe62db9758 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Aug 06 01:34:34.386350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 165/315] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:34.602746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:34.611080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e2993992-e385-4c50-bf58-f5dfaf3a35b7 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.292140 Aug 06 01:34:34.611677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 151/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:34 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:34.918664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:34.919361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:34.926048 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.926533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.926967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.927651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.928108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.928527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.960325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:34.960808 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:34.961300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:34.961744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lazy-loading 'fault' on Instance uuid af905110-5a0b-4d8e-8916-84750c75856d {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:34:35.008686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:35.016306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bae63593-53e1-434d-88bb-99f4248df99f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 200 len: 1304 microversion: 2.1 time: 0.101910 Aug 06 01:34:35.016883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 166/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:34 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:35.067876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:35.068603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:35.074565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.075144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.075648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.076405 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.076866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.077328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.081286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:35.235065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:35.243422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a6c14db6-c543-490d-86d5-5ac1a7dffc17 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.179983 Aug 06 01:34:35.244180 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 152/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:35 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:35.375342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:35.376956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:35.389395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.390297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.390935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.391952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.392606 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.394315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.446781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.448149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.449008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.449722 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lazy-loading 'fault' on Instance uuid 8c798285-436b-4040-90b1-6228ed48a138 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:34:35.510635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5823f66f313843ddac68ff7a951321ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b124d9abc46d4e85927cf1b40dd4a171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:35.526113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-308895a4-b17b-44ca-bbe4-364694dd4e30 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 200 len: 1351 microversion: 2.1 time: 0.159202 Aug 06 01:34:35.527850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 167/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:35 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:35.535912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b150724-1383-42cb-8f3c-b93cf6978ed2", "name": "network-vif-plugged", "status": "completed", "tag": "196e367b-8037-4328-8e2d-49d83b53c6bf"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:35.560319 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.560754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.561226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.577136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] Creating event network-vif-plugged:196e367b-8037-4328-8e2d-49d83b53c6bf for instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 on hv-cinder-85200 Aug 06 01:34:35.583186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-c9522716-7c05-4b1b-83c0-f01160dc1496 req-3fea4a3c-ff1e-44af-a592-49652db09723 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052273 Aug 06 01:34:35.584189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 153/320] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:34:35.633387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:35.634382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:35.641508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.642392 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.643096 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.643986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:35.644880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:35.645505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:35.805261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:35.812817 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a25c6040-793f-4f55-a76f-3247540cb79f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.183561 Aug 06 01:34:35.813680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 168/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:35 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:36.042519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:36.043782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: af905110-5a0b-4d8e-8916-84750c75856d] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:36.057392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.057942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.058378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.059145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.059643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.064394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.094913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] HTTP exception thrown: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Request method failure captured: Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d HTTP/1.1 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTnugLjXD-n3DqeA89ipiibTWE823rtFE4ZIId3uHUzElPFX5rYF2oyOE_FSPSpvErLAqYtLY1pcSHAGTT7FJpgU20Na1Lsm6Y7qk9d7fhT1Y0onGO-Jg_YstRPxO9Gqq8cfHCkhyHttvCsI6d7lUUyylsNYf44Iy0mWWumOJ_iRwI Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: d37acbae2bf64dac8eec9721189268d0 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesActionsTest-1929960611 Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:34:36.110530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d37acbae2bf64dac8eec9721189268d0"}]}] Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesActionsTest-1929960611 Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: d37acbae2bf64dac8eec9721189268d0 Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesActionsTest-1929960611 Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesActionsTest-1929960611-project Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 3f081e5336f74e21903f11df0b9d95b1 Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesActionsTest-1929960611-project Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. Aug 06 01:34:36.113140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'af905110-5a0b-4d8e-8916-84750c75856d'} Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:34:36.114196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. Aug 06 01:34:36.115818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.131326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Returning 404 to user: Instance af905110-5a0b-4d8e-8916-84750c75856d could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:34:36.131326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-41941d77-5140-4643-aca5-8d0d40ec8f37 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d" status: 404 len: 111 microversion: 2.1 time: 0.081826 Aug 06 01:34:36.131326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 154/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:36 2022] GET /compute/v2.1/servers/af905110-5a0b-4d8e-8916-84750c75856d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:34:36.264444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1367259695", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "networks": [{"uuid": "d2988fca-a7bb-42e3-8a1b-a033b645849a"}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:36.264953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:36.265695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:36.272979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.273788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.275511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.277544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.278379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.281726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.338364 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] validate_networks() for [('d2988fca-a7bb-42e3-8a1b-a033b645849a', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:34:36.591796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:36.602974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3f2f6fd4-a8ad-40b4-a484-95aec0e218d4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1523 microversion: 2.1 time: 0.342788 Aug 06 01:34:36.611501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 169/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:36 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:36.631405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:36.632958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:36.635355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:36.644928 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.645944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.649854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.650688 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.651231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.651871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.682500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] HTTP exception thrown: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Request method failure captured: Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 HTTP/1.1 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTDjcz_9CRjMIarTbLkqFtJo92cG1Qnsi53LUGUjOcdc3pYZ5nCXc5NHDcKG90mnYDEqK54SVg09KXPuGzM-GrIDusgB1fWB9ZIO2zBjFHtFMd9W2BDRFVrVByf6_3YOODhVpb64RvQ1Wo4Wp_Vx23l2xfyRLxBvEvjJziN9zE6IjY Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:34:36.687057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}] Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 5823f66f313843ddac68ff7a951321ae Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:36.688513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '8c798285-436b-4040-90b1-6228ed48a138'} Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:34:36.689643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:36.691376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:34:36.692327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Returning 404 to user: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:34:36.692327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1a3803b2-0163-48ef-bdce-c8531c596e84 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 404 len: 111 microversion: 2.1 time: 0.062523 Aug 06 01:34:36.696657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 170/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:36 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:34:36.834699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:36.835634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:36.845347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.847381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.848050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:36.849189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:36.851089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:36.853513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.050753 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:34:37.053575 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:34:37.054479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:34:37.055548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:34:37.056234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:34:37.075429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.078987 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.079582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.083293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.083933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.084447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.133325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Getting quotas for project d37acbae2bf64dac8eec9721189268d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:34:37.146854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Getting quotas for user 3f081e5336f74e21903f11df0b9d95b1 and project d37acbae2bf64dac8eec9721189268d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:34:37.160828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:34:37.163193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:34:37.221283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-76ea5699-b38a-4c8f-8575-b3a38f4e786a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960986 Aug 06 01:34:37.222470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 155/325] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 01:34:37.229111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:37.231659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:37.241463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.242253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.242773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.243588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.244203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.244643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.258967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] HTTP exception thrown: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Request method failure captured: Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138/os-volume_attachments HTTP/1.1 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTDjcz_9CRjMIarTbLkqFtJo92cG1Qnsi53LUGUjOcdc3pYZ5nCXc5NHDcKG90mnYDEqK54SVg09KXPuGzM-GrIDusgB1fWB9ZIO2zBjFHtFMd9W2BDRFVrVByf6_3YOODhVpb64RvQ1Wo4Wp_Vx23l2xfyRLxBvEvjJziN9zE6IjY Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:34:37.261184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}] Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 5823f66f313843ddac68ff7a951321ae Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:37.263055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'server_id': '8c798285-436b-4040-90b1-6228ed48a138'} Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:34:37.263875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:37.265230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:37.266675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Returning 404 to user: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:34:37.266988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c2bc4cdd-9af9-4120-a5af-ee04b7d2547f tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042282 Aug 06 01:34:37.268042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 156/326] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:34:37 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:34:37.273495 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-772a8d28-41e6-4d77-bbea-b8c5b9e338ca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:37.274656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-772a8d28-41e6-4d77-bbea-b8c5b9e338ca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:37.286096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:37.328689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:37.333570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:37.376365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-900162cf-f032-4e48-9069-6877d5764ddd tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.545404 Aug 06 01:34:37.401753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 171/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:36 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:37.468017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-772a8d28-41e6-4d77-bbea-b8c5b9e338ca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:37.481177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-772a8d28-41e6-4d77-bbea-b8c5b9e338ca tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1214 microversion: 2.1 time: 0.211005 Aug 06 01:34:37.493162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 157/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:37 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:37.633040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:37.633663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:37.654824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.655479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.656018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.657478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.658165 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.659524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.843450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:37.858522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e68bbb37-89cb-458c-a53c-1fd9bcf7d89b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1503 microversion: 2.1 time: 0.229423 Aug 06 01:34:37.860014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 172/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:37 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:37.882062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:37.882783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:37.890246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.891030 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.891682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:37.892770 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:37.893913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:37.894436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.067603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:38.076338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0884f984-9177-4e92-895b-ff3e4a9befa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1516 microversion: 2.1 time: 0.199049 Aug 06 01:34:38.090530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 158/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:37 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:38.398956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:38.402530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:38.408048 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.408708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.409322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.411315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.412178 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.415251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.504181 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:38.505078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:38.515707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.519002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.519701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.522004 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.522652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.526669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.909686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:38.923723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3772b32c-bc93-4181-b586-caa2acd8277d tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1266 microversion: 2.1 time: 0.419252 Aug 06 01:34:38.928211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 159/331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:38 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:38.937322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:38.939846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:38.977157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.981567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.982088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:38.986747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:38.987985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:38.988497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.018946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] HTTP exception thrown: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Request method failure captured: Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 HTTP/1.1 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTDjcz_9CRjMIarTbLkqFtJo92cG1Qnsi53LUGUjOcdc3pYZ5nCXc5NHDcKG90mnYDEqK54SVg09KXPuGzM-GrIDusgB1fWB9ZIO2zBjFHtFMd9W2BDRFVrVByf6_3YOODhVpb64RvQ1Wo4Wp_Vx23l2xfyRLxBvEvjJziN9zE6IjY Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:34:39.036309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}] Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 5823f66f313843ddac68ff7a951321ae Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.037949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8c798285-436b-4040-90b1-6228ed48a138'} Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:34:39.038610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.039656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.041382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Returning 404 to user: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:34:39.041382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-18ccd72b-8d5c-48d4-8572-4aed759fb07c tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 404 len: 111 microversion: 2.1 time: 0.108961 Aug 06 01:34:39.041382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 160/332] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:34:38 2022] DELETE /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:34:39.050713 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:39.056632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] [instance: 8c798285-436b-4040-90b1-6228ed48a138] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:39.066486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.067381 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.068046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.069665 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.071131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.072168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.092556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] HTTP exception thrown: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Request method failure captured: Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 HTTP/1.1 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTDjcz_9CRjMIarTbLkqFtJo92cG1Qnsi53LUGUjOcdc3pYZ5nCXc5NHDcKG90mnYDEqK54SVg09KXPuGzM-GrIDusgB1fWB9ZIO2zBjFHtFMd9W2BDRFVrVByf6_3YOODhVpb64RvQ1Wo4Wp_Vx23l2xfyRLxBvEvjJziN9zE6IjY Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:34:39.094699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b124d9abc46d4e85927cf1b40dd4a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b124d9abc46d4e85927cf1b40dd4a171"}]}] Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: b124d9abc46d4e85927cf1b40dd4a171 Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-DeleteServersTestJSON-673002597 Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 5823f66f313843ddac68ff7a951321ae Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-DeleteServersTestJSON-673002597-project Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.096100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8c798285-436b-4040-90b1-6228ed48a138'} Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:34:39.097632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. Aug 06 01:34:39.098901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:34:39.101185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] Returning 404 to user: Instance 8c798285-436b-4040-90b1-6228ed48a138 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:34:39.102196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2d455eab-b0d2-431c-acf9-acf2f57dad38 tempest-DeleteServersTestJSON-673002597 tempest-DeleteServersTestJSON-673002597-project] 10.222.0.26 "GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138" status: 404 len: 111 microversion: 2.1 time: 0.057459 Aug 06 01:34:39.103406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 161/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:39 2022] GET /compute/v2.1/servers/8c798285-436b-4040-90b1-6228ed48a138 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:34:39.349636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:39.361776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ca3302d5-ac1b-4318-9bdc-672596e89e0e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1318 microversion: 2.1 time: 0.967209 Aug 06 01:34:39.373294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 173/334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:38 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:39.816363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:39.826095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:39.843322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.845221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.845718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.847877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.848353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.851358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.907933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'flavor' on Instance uuid d9cee84e-9fda-4bcb-9513-e8b6e343ffaa {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:34:39.950539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:39.951320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:39.963760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.964353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.964789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:39.965529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:39.965987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:39.966505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:40.084790 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-15fcf770-46b3-4b97-b33e-c4bb62b198ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/action" status: 200 len: 32 microversion: 2.1 time: 0.276964 Aug 06 01:34:40.086137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 162/335] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:34:39 2022] POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:34:40.111507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:40.117693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:40.128455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:40.130132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:40.130830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:40.131780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:40.132458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:40.132598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:40.133323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:40.150226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f3243e75-e205-481f-ac57-4ebb7f967120 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1272 microversion: 2.1 time: 0.203275 Aug 06 01:34:40.164009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 174/336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:39 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:40.387836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:40.389876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:40.407873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:40.408379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:40.409763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:40.410486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:40.410949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:40.412186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:40.614261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:40.622244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4578a1d9-9530-496b-a022-1882aaf98329 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.518923 Aug 06 01:34:40.623001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 163/337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:40 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:40.974496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:40.988433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2e1007cc-86b4-4574-972e-34393ff1a045 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1506 microversion: 2.1 time: 0.604295 Aug 06 01:34:41.005171 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 175/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:40 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:41.172165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:41.172783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:41.223271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:41.223976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:41.224395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:41.225173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:41.227528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:41.235602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:41.554566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:41.565904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fe4621c5-7d39-4492-99cb-8ae91735c346 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1272 microversion: 2.1 time: 0.397417 Aug 06 01:34:41.573185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 164/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:41 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:41.644260 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:41.645902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:41.655024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:41.657690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:41.659325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:41.660091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:41.664981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:41.665483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:42.360633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:42.385318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ce789c4f-8bb6-4a3a-8c9b-d11e1d5c4588 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.744718 Aug 06 01:34:42.403073 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 176/340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:41 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:42.595695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:42.596929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:42.610724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:42.612649 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:42.613937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:42.615206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:42.616306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:42.616959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:43.151403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:43.161737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f7bca1b7-2d80-4b63-9c59-fb82ca7bdcff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.570915 Aug 06 01:34:43.162977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 165/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:42 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:43.412002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:43.412598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:43.430259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:43.431239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:43.431968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:43.433108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:43.434503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:43.438282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:43.823826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:43.836053 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5e6535a5-031f-4fee-a6f6-c8970a26be30 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.429108 Aug 06 01:34:43.852972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 177/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:43 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:44.184190 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:44.188061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:44.198647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:44.201468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:44.205853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:44.206874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:44.207731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:44.208360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:44.620709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:44.640220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bc4aa867-4969-45e1-aba9-25f49037dae5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.460712 Aug 06 01:34:44.640818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 166/343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:44 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:44.688775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d187214d-de58-43d9-925f-817e5bcba725", "tag": "520bdbbf-0413-4233-a811-9f82bfb6583b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:44.710149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:44.711679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:44.712352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:44.741806 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] Creating event network-changed:520bdbbf-0413-4233-a811-9f82bfb6583b for instance d187214d-de58-43d9-925f-817e5bcba725 on hv-cinder-85200 Aug 06 01:34:44.754069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-5fb86aa9-448f-4803-bffe-20550ec28ba3 req-578baf49-c8f0-43bb-b4c2-5e34fd39233a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069598 Aug 06 01:34:44.756985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 178/344] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:44.859246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:44.860545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:44.875321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:44.875903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:44.876429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:44.877332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:44.878327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:44.878995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:45.260416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:45.271651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6228bb2a-ff14-4a02-9bc9-4a79c905766a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.416754 Aug 06 01:34:45.272805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 167/345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:44 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:45.667088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:45.667926 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:45.681678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:45.682425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:45.683010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:45.683896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:45.684496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:45.685354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:46.073974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:46.089119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-647b1296-5976-4477-898e-8217ad79dd49 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.426397 Aug 06 01:34:46.103834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 179/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:45 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:46.301715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:46.302485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:46.314312 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:46.327888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:46.328655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:46.329922 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:46.331765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:46.332479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:46.566450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:46.574229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-faea82b5-3780-4637-a4e2-b3286dd9839b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.278644 Aug 06 01:34:46.592518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 168/347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:46 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:47.120103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:47.120721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:47.127443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:47.128517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:47.129265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:47.130463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:47.131113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:47.132637 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:47.598638 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:47.599252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:47.607806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:47.610485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=8 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:47.613943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:47.615143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:47.621441 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:47.622839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:47.624774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:47.625563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:47.885933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:47.925726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4ea2ab40-5f31-49aa-a17e-2410f8c3ebb4 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.810614 Aug 06 01:34:47.926640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 180/348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:47 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:47.938615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:47.951991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1b27936c-bf36-49c2-a605-3df5fcd898d8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.356750 Aug 06 01:34:47.953985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 169/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:47 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:48.169917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-53f6a711-5edf-43ef-b585-c4079b8b1c60 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Action: 'create', calling method: .version_select at 0x7fbff42144c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-606109071"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:48.571886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-53f6a711-5edf-43ef-b585-c4079b8b1c60 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.643782 Aug 06 01:34:48.572800 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 181/350] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Aug 6 01:34:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 645 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 01:34:48.586907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6dacb395-f413-4fc7-ada6-97f47f8d8cd6 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128700>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:48.666669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6dacb395-f413-4fc7-ada6-97f47f8d8cd6 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 200 len: 344 microversion: 2.1 time: 0.085187 Aug 06 01:34:48.667497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 170/351] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:34:48 2022] GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:48.947158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:48.947783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:48.955219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:48.956286 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:48.956907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:48.957652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:48.959164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:48.960064 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:48.974718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:48.975332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:48.985095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:48.985883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:48.986332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:48.987119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:48.987580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:48.988009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:49.362306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:49.375632 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cf0baa87-b2df-4e78-9a70-56a41b118050 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.432246 Aug 06 01:34:49.376803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 182/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:48 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:49.397223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:49.425108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-89d692d5-1d01-43c8-836d-11715ddd1c82 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.454608 Aug 06 01:34:49.429864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 171/353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:48 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:49.682003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1876f24f-5976-49be-9aa5-27592930c8f1 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff5ffc8b0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:49.744078 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1876f24f-5976-49be-9aa5-27592930c8f1 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 200 len: 345 microversion: 2.1 time: 0.067823 Aug 06 01:34:49.744875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 183/354] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:34:49 2022] GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:49.757529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3bfb80b1-e6db-4048-b008-84f2d318b341 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Action: 'create', calling method: .version_select at 0x7fbff4128700>, body: {"snapshot": {"volume_id": "3741412e-dee3-43a6-b26e-4da69c382444", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1477150502"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:49.960825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3bfb80b1-e6db-4048-b008-84f2d318b341 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.207087 Aug 06 01:34:49.965720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 172/355] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Aug 6 01:34:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:49.972851 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-22847e19-ac47-40a5-8462-f3e889624ac9 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff5ffcaf0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:50.017830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-22847e19-ac47-40a5-8462-f3e889624ac9 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.049479 Aug 06 01:34:50.025196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 184/356] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:49 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:50.032622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a8bacda4-9ea0-4fd9-810a-92c8c0744b27 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff416f430>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:50.072799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a8bacda4-9ea0-4fd9-810a-92c8c0744b27 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044538 Aug 06 01:34:50.074739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 173/357] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Aug 6 01:34:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:50.085534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e1e256c0-e088-43a6-8a0c-cee6f567e0cb tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff41180d0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:50.121490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e1e256c0-e088-43a6-8a0c-cee6f567e0cb tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.039953 Aug 06 01:34:50.128225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 185/358] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:50 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:50.405648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:50.406643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:50.414669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:50.415203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:50.415886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:50.416829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:50.417452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:50.417948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:50.449440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:50.450799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:50.472196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:50.473020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:50.473682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:50.474604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:50.475270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:50.475890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:50.662006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:50.676141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:50.679655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cae3154e-31bc-433f-82d2-9cc8b11edde0 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.281169 Aug 06 01:34:50.681290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 174/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:50 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:50.698676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:50.706951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-909111be-4969-4129-98b7-042cae32c5be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.261495 Aug 06 01:34:50.720274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 186/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:50 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:51.135075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8c751d7e-2998-4dbd-bf8f-4f84c9937726 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128940>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:51.171619 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8c751d7e-2998-4dbd-bf8f-4f84c9937726 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.040646 Aug 06 01:34:51.172689 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 175/361] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:51 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:51.558422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-44de1bab-6f7f-43f6-83ef-499ba74d08ee tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Action: 'create', calling method: .version_select at 0x7fbff416bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-822945805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUES60NC+ntr3pXVYKMjmmuvwofN39o4LdI+cljKg/jexQXRUs92DpAYltwxJh1x9IZomaHRCbghXaDMVX258EbOXoWFx/GWk7GctTwcWiLn+XAq2XMvK1qlUTc2L+Fw=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:34:51.574682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-44de1bab-6f7f-43f6-83ef-499ba74d08ee tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Getting quotas for project 722d0293c88d4711a7252d01bb91621d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:34:51.578562 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-44de1bab-6f7f-43f6-83ef-499ba74d08ee tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Getting quotas for user cbb2fa7d4e5b42388cb4a97ec3495d51 and project 722d0293c88d4711a7252d01bb91621d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:34:51.602197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-44de1bab-6f7f-43f6-83ef-499ba74d08ee tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.171672 Aug 06 01:34:51.602836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 187/362] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:34:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:51.702927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:51.703549 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:51.711489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:51.712009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:51.712429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:51.713425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:51.714107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:51.714734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:51.729296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:51.730005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:51.738350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:51.738946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:51.739449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:51.740456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:51.740917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:51.741374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:52.008788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:52.017954 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a02acc8b-4a7e-4b80-b525-017a5c7a8e08 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.318536 Aug 06 01:34:52.020273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 176/363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:51 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:52.023090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:52.032714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0011050f-5526-4081-83a2-be20750d3b32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.307212 Aug 06 01:34:52.033268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 188/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:51 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:52.185848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-00e91ba8-6bc8-4aac-b563-c6394bf59ff5 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff428aaf0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:52.262655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-00e91ba8-6bc8-4aac-b563-c6394bf59ff5 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.080839 Aug 06 01:34:52.269975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 177/365] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:52 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:53.040574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:53.041224 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:53.047630 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:53.048346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:53.049077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:53.050090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:53.050705 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:53.051301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:53.054700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:53.055360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:53.061311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:53.061873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:53.062316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:53.063016 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:53.063476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:53.063911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:53.458573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:53.468022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7d2c3c36-7467-4939-8a40-1a6b451a0fff tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.431479 Aug 06 01:34:53.478791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 189/366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:53 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:53.491504 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e36ac1ba-6e1b-4cdf-bbe2-32054a8745f3 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff41183a0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:53.529650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:53.537163 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e36ac1ba-6e1b-4cdf-bbe2-32054a8745f3 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.056952 Aug 06 01:34:53.539018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-36f3bcc6-8f3b-48d6-bfce-5a61564fce1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.488372 Aug 06 01:34:53.539606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 178/367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:53 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:53.541374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 190/368] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:53 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:54.494358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:54.495316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:54.501969 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:54.502891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:54.503740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:54.504679 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:54.505409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:54.506061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:54.550165 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-513921e1-20ff-44a9-9f2f-5c8005712dd5 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4118dc0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:54.584138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-513921e1-20ff-44a9-9f2f-5c8005712dd5 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.038145 Aug 06 01:34:54.584721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 191/369] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:54 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:34:54.593478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:54.594290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:54.603521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:54.604224 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:54.604675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:54.605946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:54.606411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:54.607045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:54.668928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:54.677823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ed3a73ae-3c47-4b54-ad1b-8cd2e03eff70 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.187962 Aug 06 01:34:54.678406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 179/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:54 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:54.762627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:54.770545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-06830c73-f0dc-4323-8d45-cdd1f7c03a0e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.184653 Aug 06 01:34:54.771119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 192/371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:54 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:55.596735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-073f1bc0-5ce2-431a-bfbb-e781898dc86c tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff40b6ca0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:55.633350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-073f1bc0-5ce2-431a-bfbb-e781898dc86c tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.040815 Aug 06 01:34:55.633996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 180/372] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:55 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:55.698297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:55.698950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:55.704867 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:55.706051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:55.706636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:55.707334 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:55.707788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:55.708213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:55.791060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:55.791754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:55.797937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:55.798422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:55.798856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:55.799599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:55.800050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:55.800470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:55.851305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:55.858905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b45ecaf6-5e44-46db-94af-59931dc280ab tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.164470 Aug 06 01:34:55.859558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 193/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:55 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:55.943505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:55.951227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7cd3b94c-41e8-4559-a7d1-5ca40ac21f45 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.164155 Aug 06 01:34:55.951790 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 181/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:55 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:56.645899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2e4c7dc0-f7a4-4136-9369-67eee43637dd tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4118820>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:56.676569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2e4c7dc0-f7a4-4136-9369-67eee43637dd tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.034493 Aug 06 01:34:56.677204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 194/375] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:56 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:56.880311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:56.880943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:56.887246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:56.887719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:56.888146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:56.888829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:56.889307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:56.889727 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:56.977262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:56.977262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:56.978849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:56.979335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:56.980146 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:56.981023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:56.981670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:56.982265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:57.038946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:57.048407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-db731ac8-8520-44ff-9a92-bbca1b183990 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.172534 Aug 06 01:34:57.049935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 182/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:56 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:57.124423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:57.132527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5064fc33-f1ed-434a-a740-92fbb31a5aea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.164666 Aug 06 01:34:57.133135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 195/377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:56 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:57.689180 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c96e875b-1311-47a4-b16c-0505e17ed02e tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4167dc0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:57.717943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c96e875b-1311-47a4-b16c-0505e17ed02e tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.032448 Aug 06 01:34:57.718510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 183/378] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:57 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:58.070621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:58.071328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:58.077513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:58.078014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:58.078642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:58.079359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:58.079835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:58.080323 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:58.155030 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:58.157162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:58.165444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:58.165993 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:58.166620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:58.167509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:58.168139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:58.168566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:58.264627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:58.272881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4f3bfb70-6af3-4521-951f-291bdb1e0d2f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.206513 Aug 06 01:34:58.273560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 196/379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:58 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:58.325169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:58.333277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-73fc3c8f-8eda-4edd-a301-044405d14c46 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.182395 Aug 06 01:34:58.333850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 184/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:58 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:58.730625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cbf1b7ad-2bfe-42d7-8e8f-69fdefd81bbf tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff5ffc8b0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:58.760134 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cbf1b7ad-2bfe-42d7-8e8f-69fdefd81bbf tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.033163 Aug 06 01:34:58.760694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 197/381] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:58 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:34:59.292893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:59.293526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:59.300056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:59.300474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:59.300908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:59.301623 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:59.302079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:59.302505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:59.354470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:59.355079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:34:59.360989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:59.362070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:59.362070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:59.362649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:34:59.363105 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:34:59.363525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:34:59.367829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:59.479795 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:59.487412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-91252730-d4b5-440e-9b36-09c101c0906b tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.198286 Aug 06 01:34:59.487991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 185/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:59 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:34:59.524197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:34:59.531676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-89bc0d0a-6b33-46a2-a782-4c9be0849a0b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.181067 Aug 06 01:34:59.532256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 198/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:34:59 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:34:59.771555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0d4c6e10-a169-4be5-8785-d2463ac48ffe tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128430>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:34:59.800942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0d4c6e10-a169-4be5-8785-d2463ac48ffe tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.033094 Aug 06 01:34:59.801558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 186/384] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:34:59 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:00.507774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:00.508394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:00.514617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:00.515231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:00.515672 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:00.516364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:00.516816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:00.517273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:00.553441 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:00.554152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:00.560168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:00.560733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:00.561272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:00.561985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:00.562422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:00.562846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:00.829300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:00.836667 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:00.837803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-89785dbe-b56a-466b-b39d-db134acfba4a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.333778 Aug 06 01:35:00.838734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 199/385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:00 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:00.846697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a4a72e3b-c74f-4028-8767-137afd7ddfca tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4118a60>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:00.847288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d103a0b4-b07b-44e1-b2d4-572774f2bfc4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.298141 Aug 06 01:35:00.861115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 187/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:00 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:00.883058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a4a72e3b-c74f-4028-8767-137afd7ddfca tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 288 microversion: 2.1 time: 0.043117 Aug 06 01:35:00.883817 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 200/387] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:35:00 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:00.895706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d426ee93-9533-4e57-9b88-3edae27dee6b tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128430>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:00.959844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d426ee93-9533-4e57-9b88-3edae27dee6b tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 202 len: 0 microversion: 2.1 time: 0.068579 Aug 06 01:35:00.961286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 188/388] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Aug 6 01:35:00 2022] DELETE /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:35:00.970124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bfe61320-f6d9-4afe-a595-79cc1533461a tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff5ffc310>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:01.001480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bfe61320-f6d9-4afe-a595-79cc1533461a tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.035370 Aug 06 01:35:01.002079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 201/389] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:35:00 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:35:01.864746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:01.866332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:01.868674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:01.869479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:01.872388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=4 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:01.872527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:01.873020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:01.876226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:01.876226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:01.876226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:01.876226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:01.877400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:01.877622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:01.878123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:01.878951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:01.879414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:01.879840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:02.083664 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:02.086583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:02.091965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0549dc5f-c97b-42a4-8249-d00d644730fe tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.233521 Aug 06 01:35:02.092629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 189/390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:01 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:02.095057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-777f64ae-70af-41cc-bf3c-b3d8ff6fcb8d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.230554 Aug 06 01:35:02.095625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 202/391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:01 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:02.101572 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-69a49c1b-14a0-44ca-8383-ebc3b41fb7a6 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128160>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:02.138066 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-69a49c1b-14a0-44ca-8383-ebc3b41fb7a6 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 200 len: 287 microversion: 2.1 time: 0.039387 Aug 06 01:35:02.138909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 190/392] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:35:02 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:03.114050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:03.114584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:03.117798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:03.118404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:03.121329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:03.121564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:03.121807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:03.122561 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:03.123033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:03.123466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:03.124361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:03.124841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:03.125293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:03.125977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:03.126420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:03.126836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:03.324139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:03.330435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:03.332642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f0de1fc-6864-4ec2-a07a-5cd28e374f73 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.222946 Aug 06 01:35:03.344413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 203/393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:03 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:03.344413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba0d52a6-9bb6-44db-b02a-2155401fce66 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff5ffcee0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:03.344895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1e684a9b-955b-4bfc-a7d0-961dc1862ed1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.225842 Aug 06 01:35:03.354210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 191/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:03 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:03.368167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-ba0d52a6-9bb6-44db-b02a-2155401fce66 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] HTTP exception thrown: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba0d52a6-9bb6-44db-b02a-2155401fce66 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Request method failure captured: Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 HTTP/1.1 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cU3SPyP5UmQyovz-TUUpH-lDOQUtyuXlHxh5YyrlXoDCfeU08Y3pusqGxuae6zcYezfc-IhWPH_1T78VtoR6MsEWbaAhvt4YKiiYcqDhyqB40U-unMcxhJsdIciA1fyNzQdJomn0QLZnYSKWbC3WMEHb_LctHolOoliSVVqR9vbtpw Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:35:03.370739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61190280a86846b5afd9b0d768f89713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61190280a86846b5afd9b0d768f89713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}] Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 2846129dffcd40abbd92eca26c271800 Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'cae6fc08-34d8-4bb5-b049-6a44faf23818'} Aug 06 01:35:03.372191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. (HTTP 404) (Request-ID: req-2af55996-1d0b-409c-b3f3-91f8fbdbff13) Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.373088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:03.374231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 06 01:35:03.375479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba0d52a6-9bb6-44db-b02a-2155401fce66 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Returning 404 to user: Snapshot cae6fc08-34d8-4bb5-b049-6a44faf23818 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ba0d52a6-9bb6-44db-b02a-2155401fce66 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818" status: 404 len: 111 microversion: 2.1 time: 0.038544 Aug 06 01:35:03.376778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 204/395] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:35:03 2022] GET /compute/v2.1/os-snapshots/cae6fc08-34d8-4bb5-b049-6a44faf23818 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:35:03.386020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7190b0f3-ba9f-487b-9e82-4abbad503952 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff411f0d0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:03.448172 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7190b0f3-ba9f-487b-9e82-4abbad503952 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 202 len: 0 microversion: 2.1 time: 0.070113 Aug 06 01:35:03.448734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 192/396] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:35:03 2022] DELETE /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 01:35:03.457549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a496a3a1-b71b-48f9-ae77-e8a79881d5e1 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff442fca0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:03.508611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a496a3a1-b71b-48f9-ae77-e8a79881d5e1 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 200 len: 344 microversion: 2.1 time: 0.055553 Aug 06 01:35:03.509551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 205/397] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:03 2022] GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:04.056423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d187214d-de58-43d9-925f-817e5bcba725", "name": "network-vif-plugged", "status": "completed", "tag": "520bdbbf-0413-4233-a811-9f82bfb6583b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:04.066284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:04.066887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:04.067389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:04.078290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] Creating event network-vif-plugged:520bdbbf-0413-4233-a811-9f82bfb6583b for instance d187214d-de58-43d9-925f-817e5bcba725 on hv-cinder-85200 Aug 06 01:35:04.083119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-1629e5a9-d464-4e41-966e-7143745d235d req-44f272a9-3a9e-47ae-8d64-944925de6ceb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030395 Aug 06 01:35:04.083709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 193/398] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:04.356427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:04.357159 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:04.362041 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:04.363421 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:04.364156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:04.364978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:04.365897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:04.366783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:04.367594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:04.368261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:04.370840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:04.371518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:04.373770 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:04.374821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:04.375291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:04.375715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:04.596538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:04.605790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7749f347-dcac-46d8-b444-ea9347ca625f tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.253111 Aug 06 01:35:04.606686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 206/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:04 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:04.611279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:04.613009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-49ea94ba-3032-47ac-a9a2-92338322c207 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff416bb80>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:04.630900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5c433d62-8ce3-441c-abfa-1507fffc8194 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.273170 Aug 06 01:35:04.635054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 194/400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:04 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:04.648713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-49ea94ba-3032-47ac-a9a2-92338322c207 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] HTTP exception thrown: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-49ea94ba-3032-47ac-a9a2-92338322c207 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Request method failure captured: Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 HTTP/1.1 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cU3SPyP5UmQyovz-TUUpH-lDOQUtyuXlHxh5YyrlXoDCfeU08Y3pusqGxuae6zcYezfc-IhWPH_1T78VtoR6MsEWbaAhvt4YKiiYcqDhyqB40U-unMcxhJsdIciA1fyNzQdJomn0QLZnYSKWbC3WMEHb_LctHolOoliSVVqR9vbtpw Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:35:04.651579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61190280a86846b5afd9b0d768f89713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61190280a86846b5afd9b0d768f89713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}] Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 2846129dffcd40abbd92eca26c271800 Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '3741412e-dee3-43a6-b26e-4da69c382444'} Aug 06 01:35:04.653024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. (HTTP 404) (Request-ID: req-e1e749e8-2b2e-4609-b840-cc1aea05528f) Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.653772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:04.654896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 01:35:04.655908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-49ea94ba-3032-47ac-a9a2-92338322c207 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Returning 404 to user: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-49ea94ba-3032-47ac-a9a2-92338322c207 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 404 len: 109 microversion: 2.1 time: 0.045642 Aug 06 01:35:04.656967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 207/401] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:04 2022] GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:35:04.666139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-05f33652-ad98-46b9-bd94-28ca2509c8ea tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff4128700>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:04.695674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-05f33652-ad98-46b9-bd94-28ca2509c8ea tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] HTTP exception thrown: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-05f33652-ad98-46b9-bd94-28ca2509c8ea tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Request method failure captured: Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 HTTP/1.1 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cU3SPyP5UmQyovz-TUUpH-lDOQUtyuXlHxh5YyrlXoDCfeU08Y3pusqGxuae6zcYezfc-IhWPH_1T78VtoR6MsEWbaAhvt4YKiiYcqDhyqB40U-unMcxhJsdIciA1fyNzQdJomn0QLZnYSKWbC3WMEHb_LctHolOoliSVVqR9vbtpw Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:35:04.697880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61190280a86846b5afd9b0d768f89713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61190280a86846b5afd9b0d768f89713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}] Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 2846129dffcd40abbd92eca26c271800 Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '3741412e-dee3-43a6-b26e-4da69c382444'} Aug 06 01:35:04.699332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. (HTTP 404) (Request-ID: req-ad76a737-789d-4d8f-a97c-439d821ac602) Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.700232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 01:35:04.701369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 01:35:04.702370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-05f33652-ad98-46b9-bd94-28ca2509c8ea tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Returning 404 to user: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-05f33652-ad98-46b9-bd94-28ca2509c8ea tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 404 len: 109 microversion: 2.1 time: 0.037044 Aug 06 01:35:04.703396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 195/402] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:35:04 2022] DELETE /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:35:04.709461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0a3800a2-cc58-4f96-9adb-7fdd5898aff7 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Calling method '.version_select at 0x7fbff41189d0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:04.738833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-0a3800a2-cc58-4f96-9adb-7fdd5898aff7 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] HTTP exception thrown: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0a3800a2-cc58-4f96-9adb-7fdd5898aff7 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Request method failure captured: Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 HTTP/1.1 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cU3SPyP5UmQyovz-TUUpH-lDOQUtyuXlHxh5YyrlXoDCfeU08Y3pusqGxuae6zcYezfc-IhWPH_1T78VtoR6MsEWbaAhvt4YKiiYcqDhyqB40U-unMcxhJsdIciA1fyNzQdJomn0QLZnYSKWbC3WMEHb_LctHolOoliSVVqR9vbtpw Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:35:04.741139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61190280a86846b5afd9b0d768f89713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61190280a86846b5afd9b0d768f89713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61190280a86846b5afd9b0d768f89713"}]}] Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 61190280a86846b5afd9b0d768f89713 Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-722375582 Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 2846129dffcd40abbd92eca26c271800 Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesSnapshotsTestJSON-722375582-project Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '3741412e-dee3-43a6-b26e-4da69c382444'} Aug 06 01:35:04.742560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. (HTTP 404) (Request-ID: req-9fb8cc0c-e3ce-4dff-b98c-1a1656dde322) Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.743996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:04.745221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 01:35:04.746441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0a3800a2-cc58-4f96-9adb-7fdd5898aff7 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] Returning 404 to user: Volume 3741412e-dee3-43a6-b26e-4da69c382444 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0a3800a2-cc58-4f96-9adb-7fdd5898aff7 tempest-VolumesSnapshotsTestJSON-722375582 tempest-VolumesSnapshotsTestJSON-722375582-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444" status: 404 len: 109 microversion: 2.1 time: 0.037171 Aug 06 01:35:04.747605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 208/403] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:04 2022] GET /compute/v2.1/os-volumes/3741412e-dee3-43a6-b26e-4da69c382444 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:35:05.629371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:05.630083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:05.637619 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:05.638736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:05.639181 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:05.639891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:05.640355 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:05.640795 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:05.655091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:05.655818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:05.664283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:05.665006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:05.665796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:05.667108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:05.668026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:05.668466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:05.859457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:05.867727 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-42a62662-0e29-41bd-a7fd-794bb9f1cc7c tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.243706 Aug 06 01:35:05.872285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:05.880961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0805fac9-be72-47be-9702-a0efebe216f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.230808 Aug 06 01:35:05.881283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 196/404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:05 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:05.881814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 209/405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:05 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:06.300593 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4602cec1-1b7f-493b-85b8-117acd648ecf tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Action: 'create', calling method: .version_select at 0x7fbff4270a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-488030573", "metadata": {"Type": "work"}}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:06.610017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4602cec1-1b7f-493b-85b8-117acd648ecf tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.429163 Aug 06 01:35:06.611630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 197/406] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Aug 6 01:35:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 01:35:06.626566 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-92d2516d-cd1c-4aec-89a9-499073ea5964 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff5ffcaf0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:06.675460 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-92d2516d-cd1c-4aec-89a9-499073ea5964 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 200 len: 352 microversion: 2.1 time: 0.054738 Aug 06 01:35:06.676044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 210/407] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:06 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:06.888227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:06.888740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:06.895463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:06.896063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:06.896503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:06.897221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:06.897680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:06.898105 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:06.901610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:06.902247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:06.904088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:06.909369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:06.909851 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:06.910291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:06.911527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:06.912175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:06.912601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:07.095522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:07.103693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cbc49b43-7b44-4f19-b911-838ec35335eb tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1314 microversion: 2.1 time: 0.219830 Aug 06 01:35:07.104914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 198/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:06 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:07.106945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:07.116688 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-230a395e-d28a-4680-b568-7d7a4024b4e6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.218767 Aug 06 01:35:07.117316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 211/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:06 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:07.688995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-93a1f14a-e4bd-4320-bab3-32d131c76bd3 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff42701f0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:07.742435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-93a1f14a-e4bd-4320-bab3-32d131c76bd3 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 200 len: 352 microversion: 2.1 time: 0.056597 Aug 06 01:35:07.743394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 199/410] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:07 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:08.126453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:08.127062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:08.133692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:08.134167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:08.134599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:08.135293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:08.135746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:08.136166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:08.137834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:08.138498 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:08.140544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=58 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:08.149486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:08.150277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:08.150705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:08.151722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:08.152210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:08.152804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:08.345138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:08.348283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:08.354396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c1369330-5f7f-4afe-96f8-ac2045a8a17a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1498 microversion: 2.1 time: 0.231807 Aug 06 01:35:08.354976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 212/411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:08 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:08.357331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a3c55afd-687e-4c3e-8b56-18ec1affd5b3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.223880 Aug 06 01:35:08.357972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 200/412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:08 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:08.756005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cd1bab51-78cd-47b9-bbd4-e0ef6aee21b8 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff4118dc0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:08.804836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cd1bab51-78cd-47b9-bbd4-e0ef6aee21b8 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 200 len: 353 microversion: 2.1 time: 0.052792 Aug 06 01:35:08.806115 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 213/413] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:08 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:35:08.818445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-997ca990-cbc5-4fa6-8a66-72103d4c57bb tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff41280d0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:08.867361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-997ca990-cbc5-4fa6-8a66-72103d4c57bb tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 200 len: 353 microversion: 2.1 time: 0.052544 Aug 06 01:35:08.867996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 201/414] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:08 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:08.885512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8f0d0653-cf47-486e-b1c0-bc8d59d761f5 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff416be50>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:08.945418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8f0d0653-cf47-486e-b1c0-bc8d59d761f5 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 202 len: 0 microversion: 2.1 time: 0.064260 Aug 06 01:35:08.946517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 214/415] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:35:08 2022] DELETE /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:35:08.954485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-68111617-a07d-4de9-ab5e-1ef9c4eaf940 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff4167d30>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:09.002276 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-68111617-a07d-4de9-ab5e-1ef9c4eaf940 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 200 len: 352 microversion: 2.1 time: 0.051513 Aug 06 01:35:09.002933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 202/416] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:08 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:09.028289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:09.028792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.035757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.036250 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.036692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.037495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.038034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.038460 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.063798 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:35:09.150466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e4081ba8-0b6a-4729-9b3d-7fbc81ef07c3 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 204 len: 0 microversion: 2.1 time: 0.126559 Aug 06 01:35:09.151156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 215/417] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:35:09 2022] DELETE /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:35:09.159690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:09.160303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.167077 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.167546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.167980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.168674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.169168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.169609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.305598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:09.318592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-95434145-3710-4ff5-b889-49f9385dc955 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1504 microversion: 2.1 time: 0.163179 Aug 06 01:35:09.319476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 203/418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:09 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:09.382144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:09.382780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.389433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.389912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.390343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.391026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.391478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.391899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.532965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:09.540434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9de92e3f-7c84-417f-bab7-b5e2a28b45ba tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1502 microversion: 2.1 time: 0.162574 Aug 06 01:35:09.541238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 216/419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:09 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:09.561631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ec1e95-3322-4792-a784-97e911500bb2"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:09.564062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.571537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.572037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.572482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.573254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.573711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.574150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.598477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] HTTP exception thrown: Cannot 'attach_volume' instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa while it is in vm_state rescued Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Request method failure captured: Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/os-volume_attachments HTTP/1.1 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 74 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTMZEeLKmdAk2wwAQwH3HEqzFkDLkrWuGFB_kp5ALj0Tflf-cibgVNKTQIVAgoK82V5HDXLw41_PYvvRQl4PPOkL7CXXSflc41cG1JP1FEMYFATEzQiHwUbpItUPjmm2a5Z_QZj376Li7_YdymTh6GhuBF-FXSgH-y1e7WUkc4bVMY Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:35:09.600288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}] Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 37c704ce557c4f309cf00ef32646235f Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {"volumeAttachment": {"volumeId": "b5ec1e95-3322-4792-a784-97e911500bb2"}} Aug 06 01:35:09.601816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Cannot 'attach_volume' instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa while it is in vm_state rescued Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'server_id': 'd9cee84e-9fda-4bcb-9513-e8b6e343ffaa', 'body': {'volumeAttachment': {'volumeId': 'b5ec1e95-3322-4792-a784-97e911500bb2'}}} Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:09.602685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa while it is in vm_state rescued Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:09.603982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa while it is in vm_state rescued Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Returning 409 to user: Cannot 'attach_volume' instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa while it is in vm_state rescued {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-245044bc-5bf2-43c9-be04-4115f1f10257 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044632 Aug 06 01:35:09.605279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 204/420] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:35:09 2022] POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 06 01:35:09.611197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:09.611740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.618768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.619256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.619694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.620386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.620845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.621306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.688661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-92f6f900-157c-427e-88a1-4ab4a2e4e516 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/action" status: 202 len: 0 microversion: 2.1 time: 0.081213 Aug 06 01:35:09.689335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 217/421] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:35:09 2022] POST /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:35:09.697494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:09.698102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:09.704031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.704510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.704942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.705653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:09.706109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:09.706530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:09.725671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:09.838924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:09.846404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ce8e5231-b3f5-43ab-8803-ea5d1210cc28 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1510 microversion: 2.1 time: 0.152792 Aug 06 01:35:09.846974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 205/422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:09 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:10.017214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-42ebe211-623e-475b-a415-3b41cd235687 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Calling method '.version_select at 0x7fbff4118040>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:10.045114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-42ebe211-623e-475b-a415-3b41cd235687 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] HTTP exception thrown: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-42ebe211-623e-475b-a415-3b41cd235687 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Request method failure captured: Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a HTTP/1.1 Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cVKOPNoEKxLGroq811Z7tkvrVqv9fp2WjWK5WPi7GJVNQqWfoCTZUwmpuMA0OZOlU-3tR9svb1d0xwKwWwDyU7anFcMw8M8mrcxLpSPIn5bINwzzSRRvJbRaWYX4VmYSPA8YMky_bxtUdycmvh4fB28z-gMOmGd9kxCGukEWR1neOQ Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 0ac6c86684404d59b781c4489c8cc5fe Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesGetTestJSON-284349663 Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:35:10.047116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ac6c86684404d59b781c4489c8cc5fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ac6c86684404d59b781c4489c8cc5fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ac6c86684404d59b781c4489c8cc5fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ac6c86684404d59b781c4489c8cc5fe"}]}] Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesGetTestJSON-284349663 Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 0ac6c86684404d59b781c4489c8cc5fe Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesGetTestJSON-284349663 Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesGetTestJSON-284349663-project Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 3b05532eb4ff45a8861a07291298a212 Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesGetTestJSON-284349663-project Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '061e071e-aefb-48e3-ba13-5a193e75293a'} Aug 06 01:35:10.048527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. (HTTP 404) (Request-ID: req-df095640-3f2d-480f-87ae-9b0a93cbd859) Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:10.049463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 01:35:10.050640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 01:35:10.051951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-42ebe211-623e-475b-a415-3b41cd235687 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] Returning 404 to user: Volume 061e071e-aefb-48e3-ba13-5a193e75293a could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-42ebe211-623e-475b-a415-3b41cd235687 tempest-VolumesGetTestJSON-284349663 tempest-VolumesGetTestJSON-284349663-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a" status: 404 len: 109 microversion: 2.1 time: 0.035662 Aug 06 01:35:10.053512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 218/423] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Aug 6 01:35:10 2022] GET /compute/v2.1/os-volumes/061e071e-aefb-48e3-ba13-5a193e75293a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:35:10.339778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:10.340382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:10.346670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:10.347145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:10.347573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:10.348258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:10.348709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:10.349157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:10.536056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:10.545259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-90c41fb8-cde9-4428-a08c-687375e6dbdf tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1504 microversion: 2.1 time: 0.209183 Aug 06 01:35:10.545967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 206/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:10 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:10.869880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:10.871223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:10.878671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:10.879164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:10.879610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:10.880343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:10.880803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:10.881273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:11.109225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:11.118683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-84e4056d-fb7c-4ca0-951b-07281d7b44b1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1510 microversion: 2.1 time: 0.253310 Aug 06 01:35:11.119671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 219/425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:10 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:11.566853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:11.567550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:11.574696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:11.575175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:11.575605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:11.576288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:11.576739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:11.577179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:12.140090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:12.149665 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:12.153394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:12.160780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1983e3ba-d116-4f2f-ab66-521f1ffe1895 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1504 microversion: 2.1 time: 0.597700 Aug 06 01:35:12.163653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 207/426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:11 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:12.165679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:12.166568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:12.167087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:12.167882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:12.168549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:12.169385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:12.470396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:12.480913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bf5c31c7-3506-47d7-9ba3-9eafff52a15e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1510 microversion: 2.1 time: 0.344462 Aug 06 01:35:12.481686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 220/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:12 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:12.607851 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d187214d-de58-43d9-925f-817e5bcba725", "name": "network-vif-deleted", "tag": "520bdbbf-0413-4233-a811-9f82bfb6583b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:12.623664 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:12.624231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:12.624669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:12.637294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] Creating event network-vif-deleted:520bdbbf-0413-4233-a811-9f82bfb6583b for instance d187214d-de58-43d9-925f-817e5bcba725 on hv-cinder-85200 Aug 06 01:35:12.642223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-db7a5856-746b-4e72-8f3e-544cac9b9e92 req-06fa2fad-e1b5-43c5-a181-22b488697b67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038888 Aug 06 01:35:12.642830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 208/428] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:35:13.187212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:13.187827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:13.194090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:13.194618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:13.195079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:13.196361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:13.196880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:13.197345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:13.227896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:13.228386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:13.228829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:13.229309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lazy-loading 'fault' on Instance uuid d187214d-de58-43d9-925f-817e5bcba725 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:35:13.282393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:13.285968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:13.290437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-812e84d8-51c6-4e5d-ade6-2d61f78db660 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1304 microversion: 2.1 time: 0.107143 Aug 06 01:35:13.291127 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 221/429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:13 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:13.502796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:13.503515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:13.510574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:13.511066 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:13.511505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:13.512194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:13.512648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:13.513096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:13.657691 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:13.666215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a7deb915-0b66-42a6-bdf6-801085149de8 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1510 microversion: 2.1 time: 0.167556 Aug 06 01:35:13.666947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 209/430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:13 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:14.311714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:14.320089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:14.328765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:14.329308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:14.329863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:14.330573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:14.331026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:14.331449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:14.367079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:14.367718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:14.368184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:14.368631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lazy-loading 'fault' on Instance uuid d187214d-de58-43d9-925f-817e5bcba725 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:35:14.421208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:14.428813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-17c9fbf6-a66d-45cb-89ff-097219dc8039 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1304 microversion: 2.1 time: 0.121496 Aug 06 01:35:14.429414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 222/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:14 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:14.688939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:14.689589 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:14.696288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:14.696877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:14.697360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:14.698042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:14.698478 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:14.698909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:14.835757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:14.843846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-767e3eab-131b-4aef-82d2-a86cb7c15f9b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1510 microversion: 2.1 time: 0.158654 Aug 06 01:35:14.844416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 210/432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:14 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:15.449066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:15.449694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:15.455726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:15.456215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:15.456658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:15.457438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:15.457848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:15.458303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:15.492989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:15.493515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:15.493959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:15.494408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lazy-loading 'fault' on Instance uuid d187214d-de58-43d9-925f-817e5bcba725 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:35:15.542027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f081e5336f74e21903f11df0b9d95b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37acbae2bf64dac8eec9721189268d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:15.549572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-32a7f7da-e560-4f46-b049-09537b93811a tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 200 len: 1304 microversion: 2.1 time: 0.104476 Aug 06 01:35:15.550143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 223/433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:15 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:15.866106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:15.866966 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:15.873527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:15.874255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:15.874879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:15.875757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:15.876442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:15.877109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:16.026841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:16.034902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8706a9e4-7749-4f59-a37e-1be46d6d90fb tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1516 microversion: 2.1 time: 0.174859 Aug 06 01:35:16.035729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 211/434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:15 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:16.570275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:16.572306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] [instance: d187214d-de58-43d9-925f-817e5bcba725] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:16.578233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:16.578780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:16.579295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:16.580045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:16.580501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:16.580919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:16.595608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] HTTP exception thrown: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Request method failure captured: Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 HTTP/1.1 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTnugLjXD-n3DqeA89ipiibTWE823rtFE4ZIId3uHUzElPFX5rYF2oyOE_FSPSpvErLAqYtLY1pcSHAGTT7FJpgU20Na1Lsm6Y7qk9d7fhT1Y0onGO-Jg_YstRPxO9Gqq8cfHCkhyHttvCsI6d7lUUyylsNYf44Iy0mWWumOJ_iRwI Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: d37acbae2bf64dac8eec9721189268d0 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesActionsTest-1929960611 Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:35:16.597382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d37acbae2bf64dac8eec9721189268d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d37acbae2bf64dac8eec9721189268d0"}]}] Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesActionsTest-1929960611 Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: d37acbae2bf64dac8eec9721189268d0 Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesActionsTest-1929960611 Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesActionsTest-1929960611-project Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 3f081e5336f74e21903f11df0b9d95b1 Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesActionsTest-1929960611-project Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. Aug 06 01:35:16.598642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd187214d-de58-43d9-925f-817e5bcba725'} Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:35:16.599338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. Aug 06 01:35:16.600495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:35:16.601535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] Returning 404 to user: Instance d187214d-de58-43d9-925f-817e5bcba725 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:35:16.601535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-102d2edc-3fcf-4f76-afae-9418e17906a5 tempest-VolumesActionsTest-1929960611 tempest-VolumesActionsTest-1929960611-project] 10.222.0.26 "GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725" status: 404 len: 111 microversion: 2.1 time: 0.032338 Aug 06 01:35:16.601535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 224/435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:16 2022] GET /compute/v2.1/servers/d187214d-de58-43d9-925f-817e5bcba725 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:35:18.514416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-82af251c-c677-47a7-ac59-e50649419ad9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: .version_select at 0x7fbff428a8b0>, body: {"keypair": {"name": "tempest-keypair-676609042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcr6oaXzoGE/VQYOoJF3L0chpqz2yz3RikDYUNhVPnH5SVIsyJshINkvIM+kHHTP5QPT3MBWj+uGWZg7VTrb5dxOT39XLrdZA8lpUcIktg8pErOIC5juaDcMo8YTBiAVQ=="}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:18.545722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-82af251c-c677-47a7-ac59-e50649419ad9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for project 5be6efff0f0d482180e74f1cd075b592. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:35:18.549654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-82af251c-c677-47a7-ac59-e50649419ad9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for user 37c704ce557c4f309cf00ef32646235f and project 5be6efff0f0d482180e74f1cd075b592. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:35:18.587880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-82af251c-c677-47a7-ac59-e50649419ad9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077190 Aug 06 01:35:18.588891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 212/436] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:35:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:20.188226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1006457388", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c160c4ef-4511-4d2d-89d0-59e11df0d580"}], "security_groups": [{"name": "tempest-securitygroup--1003844374"}], "key_name": "tempest-keypair-676609042", "user_data": "}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:20.296844 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] validate_networks() for [('c160c4ef-4511-4d2d-89d0-59e11df0d580', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:35:20.699170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:35:20.699594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:35:20.700066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:35:20.700470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:35:20.700918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:35:20.710505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:20.711019 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:20.711597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:20.712328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:20.712779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:20.713243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:20.729546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:35:20.733622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Getting quotas for user 37c704ce557c4f309cf00ef32646235f and project 5be6efff0f0d482180e74f1cd075b592. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:35:20.745402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:35:20.747630 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:35:20.794514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-404ca3a0-95a5-4afc-9617-4a1855133648 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.614721 Aug 06 01:35:20.795169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 225/437] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:35:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:35:20.807222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b57cf519-179c-439b-b47e-f1651ca0e166 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:20.808079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b57cf519-179c-439b-b47e-f1651ca0e166 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:20.869590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b57cf519-179c-439b-b47e-f1651ca0e166 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:20.877229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b57cf519-179c-439b-b47e-f1651ca0e166 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1245 microversion: 2.1 time: 0.074977 Aug 06 01:35:20.877802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 213/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:20 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:21.899563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:21.900127 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:21.906032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:21.906510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:21.906940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:21.907618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:21.908066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:21.908486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:21.968117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:21.975344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-82175853-beca-45cd-9826-cab09b3ebfa1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1249 microversion: 2.1 time: 0.080558 Aug 06 01:35:21.975893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 226/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:21 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:22.995814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:22.996432 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:23.002923 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:23.003400 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:23.003832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:23.004516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:23.004966 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:23.005418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:23.069587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:23.077142 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f52aa43b-acea-4ce7-9513-2414f778ec02 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1249 microversion: 2.1 time: 0.085171 Aug 06 01:35:23.077722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 214/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:22 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:24.098414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:24.098966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:24.105443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:24.105929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:24.106359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:24.107034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:24.107486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:24.107908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:24.173345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:24.180905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0718b060-2a8c-4039-97bc-9edde1865b7b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1249 microversion: 2.1 time: 0.086450 Aug 06 01:35:24.181515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 227/441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:24 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:25.201092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:25.201706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:25.208018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:25.208503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:25.208939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:25.209642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:25.210103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:25.210541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:25.274646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:25.282371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9b693996-2ac4-49cd-b9df-9f81af0394de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1249 microversion: 2.1 time: 0.085082 Aug 06 01:35:25.282939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 215/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:25 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:26.303165 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:26.303767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:26.310776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:26.311251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:26.311682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:26.312357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:26.312805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:26.313257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:26.373931 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:26.381333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-862b3921-d9a6-4346-a40b-fb48b11be470 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1249 microversion: 2.1 time: 0.081934 Aug 06 01:35:26.381899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 228/443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:26 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:27.402537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:27.403145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:27.409576 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:27.410053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:27.410481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:27.411164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:27.411611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:27.412031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:27.476939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:27.484399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9aa0be14-94f8-4d25-a031-1e26b70c1484 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1297 microversion: 2.1 time: 0.086543 Aug 06 01:35:27.484989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 216/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:27 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:28.505660 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:28.506356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:28.512652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:28.513212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:28.513734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:28.514574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:28.515040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:28.515459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:28.613005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:28.621494 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-172cf691-5fdb-498f-8652-fc3752d850be tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1303 microversion: 2.1 time: 0.119709 Aug 06 01:35:28.622070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 229/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:28 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:29.340731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:29.351146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:29.352365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:29.353129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:29.364769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] Creating event network-changed:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:35:29.370779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-3d1441ca-8f98-40c3-a241-cdcb2184aa19 req-9bebd431-f959-4fcb-86c0-d25cbedfb162 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034647 Aug 06 01:35:29.371397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 217/446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:29.641619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:29.642234 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:29.648190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:29.648744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:29.649226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:29.649991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:29.650668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:29.651305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:30.105386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:30.122597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-099965a8-0a80-495f-acd3-5bae84d99647 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.480489 Aug 06 01:35:30.130959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 230/447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:29 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:31.144706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:31.151900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:31.168742 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:31.176526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:31.177024 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:31.177509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:31.178224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:31.178720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:31.179147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:31.323702 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:31.331073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2b3ef4cf-c1a0-482f-9b1a-b75e7c70fbf3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.189853 Aug 06 01:35:31.331635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 218/448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:31 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:32.352635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:32.353457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:32.359553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:32.360977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:32.363794 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:32.364862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:32.365985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:32.378405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:32.379294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:32.379938 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:32.541669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:32.552972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-65192b71-18eb-4d65-bc58-7388f698374b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.204551 Aug 06 01:35:32.557442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 231/449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:32 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:33.588048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:33.589408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:33.599000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:33.600257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:33.600902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:33.602939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:33.603672 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:33.604402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:33.782500 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:33.790630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c68bc0b1-0385-4791-99ca-a25620b852ad tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.216317 Aug 06 01:35:33.791504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 219/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:33 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:34.818664 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:34.819302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:34.825649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:34.826135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:34.826573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:34.827262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:34.827719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:34.828147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:34.969862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:34.978055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-76c87f93-f517-479f-8f3a-34964f30465d tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.163170 Aug 06 01:35:34.978557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 232/451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:34 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:35.998491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:35.999099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:36.005443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:36.005929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:36.006360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:36.007069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:36.007521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:36.007950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:36.144366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:36.153249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ee3733f5-59e1-4007-83a3-f26117722673 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.158510 Aug 06 01:35:36.153885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 220/452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:35 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:37.183512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:37.184334 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:37.186816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:37.201504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e95bd376-dd57-40e9-b354-bca43745e54f", "device": "/dev/sdb"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:37.204825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:37.205524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:37.207003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:37.207791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:37.209289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:37.210459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:37.211779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:37.222625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:37.224912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:37.227036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:37.228528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:37.229946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:37.232600 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:37.443216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:37.460525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-898ee7ee-98e1-43c8-abea-5da873af6f04 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.285928 Aug 06 01:35:37.461732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 233/453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:37 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:37.664740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9edceca3-157f-456a-bb78-a0d817b96120 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "POST /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467370 Aug 06 01:35:37.666577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 221/454] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:35:37 2022] POST /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:38.484981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:38.486384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:38.495672 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:38.496170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:38.496614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:38.497361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:38.497824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:38.498262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:38.671732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:38.679824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e0438533-fa10-4143-93ef-65c5382a355f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.199380 Aug 06 01:35:38.680612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 234/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:38 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:39.701838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:39.702850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:39.706137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:39.711895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:39.712510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:39.712951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:39.713756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:39.714219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:39.714648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:39.731056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:39.866291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:39.875712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-99439198-e399-4c13-9a87-a98f7b0bc2c1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.178687 Aug 06 01:35:39.883293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 222/456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:39 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:40.896972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:40.897861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:40.904831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:40.905652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:40.906311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:40.907189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:40.907730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:40.908301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:41.074135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:41.082040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8b760684-2ddd-43d7-a4e0-9e0e2439e749 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.188893 Aug 06 01:35:41.082629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:40 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:42.125714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:42.127785 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:42.142807 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:42.144294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:42.145961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:42.149269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:42.150513 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:42.151359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:42.372668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:42.381555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-96d9ee2d-ef4a-4fc3-8152-d21246a3d4cc tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.260273 Aug 06 01:35:42.382282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 223/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:42 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:43.404825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:43.405724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:43.415801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:43.416429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:43.416971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:43.417833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:43.418407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:43.418982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:43.573076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:43.581973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-53ed81fc-5402-41a2-8c7b-3aaf20abd705 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.182239 Aug 06 01:35:43.595820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 236/459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:43 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:44.193382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "name": "network-vif-plugged", "status": "completed", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:44.205526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:44.206291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:44.206939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:44.221835 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] Creating event network-vif-plugged:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:35:44.227311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-726db38a-6136-482f-ab03-f2887684eb66 req-bc9e95fd-0440-47a9-b280-7a18474c2968 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042675 Aug 06 01:35:44.228435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 224/460] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:44.603935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:44.604655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:44.610542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:44.611250 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:44.611873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:44.612741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:44.613381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:44.613962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:44.619328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=87 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:44.815564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:44.824594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ac3e8943-1007-42d9-b579-97762db82c1c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.224690 Aug 06 01:35:44.838536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 237/461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:44 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:45.846460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:45.847500 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:45.854423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:45.854907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:45.855573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:45.856455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:45.857103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:45.857568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:46.020374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:46.028517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3c716474-456b-4ad1-804a-14247508fb5c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.186214 Aug 06 01:35:46.041231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 225/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:45 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:47.050345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:47.050949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:47.057268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:47.057975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:47.058413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:47.059116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:47.059597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:47.060232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:47.224940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:47.234413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-98607d0f-141b-48ea-a6b6-5da33b83cab1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.187809 Aug 06 01:35:47.245360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 238/463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:47 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:35:48.255548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:48.256160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:48.263590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:48.264081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:48.264517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:48.265249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:48.265712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:48.266164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:48.408592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:48.417440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-155d32df-3065-4c25-a4f9-f0fe7c8c02de tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1371 microversion: 2.1 time: 0.165645 Aug 06 01:35:48.418029 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 226/464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:48 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:49.437730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:49.438337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:49.444266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:49.444745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:49.445301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:49.446551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:49.447035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:49.447654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:49.578031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:49.585763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ca93d311-5328-49f2-95d7-c3a2216c1af1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1565 microversion: 2.1 time: 0.151860 Aug 06 01:35:49.586413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 239/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:49 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:49.606362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:49.606909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:49.613344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:49.613834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:49.614253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:49.614946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:49.615406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:49.616098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:49.694824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-776fa523-1bdf-4b15-b34e-ce0a09b3f8f6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092268 Aug 06 01:35:49.696324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 227/466] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:35:49 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:50.668944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:50.678663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:50.679145 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:50.679577 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:50.693918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] Creating event network-changed:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:35:50.698754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-77be2c0f-5709-40da-8b23-43a59410fc8f req-e11dc21d-24b1-4e75-889c-803fea5ef107 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034352 Aug 06 01:35:50.699673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 240/467] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:51.124889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-790097097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-822945805", "security_groups": [{"name": "tempest-secgroup-smoke-391774887"}], "networks": [{"uuid": "89948f1b-dfa8-4646-9133-b4fd0506fa32"}], "block_device_mapping_v2": [{"uuid": "0d9ba6f7-2e74-4b65-bc95-0093d1e6e990", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:51.326499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] validate_networks() for [('89948f1b-dfa8-4646-9133-b4fd0506fa32', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:35:51.992366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:35:51.993635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:35:51.994106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:35:51.994695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:35:51.995108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:35:52.003959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:52.004819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:52.005449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:52.006171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:52.006622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:52.007037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:52.025787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Getting quotas for project 722d0293c88d4711a7252d01bb91621d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:35:52.030624 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Getting quotas for user cbb2fa7d4e5b42388cb4a97ec3495d51 and project 722d0293c88d4711a7252d01bb91621d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:35:52.091363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:35:52.093514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d9ba6f7-2e74-4b65-bc95-0093d1e6e990',volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:35:52.220331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-08945297-7a6d-455e-b5a4-ddbc831269ea tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.101056 Aug 06 01:35:52.221354 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 228/468] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:35:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:35:52.232614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c9189ed7-ccf4-4bfe-87a3-69110308c517 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:52.233355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c9189ed7-ccf4-4bfe-87a3-69110308c517 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:52.296912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c9189ed7-ccf4-4bfe-87a3-69110308c517 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:52.304986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c9189ed7-ccf4-4bfe-87a3-69110308c517 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1087 microversion: 2.1 time: 0.076675 Aug 06 01:35:52.306891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 241/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:52 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:53.327407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:53.328006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:53.348555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:53.349303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:53.350903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:53.351768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:53.352468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:53.353151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:53.493978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:53.506858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fb4130a0-ba90-46b8-84b5-34b744ab82a8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1193 microversion: 2.1 time: 0.183295 Aug 06 01:35:53.509655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 229/470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:53 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1193 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:54.532077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:54.532768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:54.542185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:54.544083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:54.544788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:54.545645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:54.549720 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:54.550136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:54.820097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:54.841847 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-66589cb3-e7c2-4053-b9e8-1acde2f15dda tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.313972 Aug 06 01:35:54.859764 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 242/471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:54 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:55.372138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:35:55.384308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:55.384780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:55.385287 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:55.400282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] Creating event network-changed:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:35:55.405801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-8257d4c6-19c4-4700-9b59-bfe0ec0d240b req-3e28c2c6-923c-4e9a-b96c-b864685e716e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038088 Aug 06 01:35:55.406609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 230/472] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:35:55.862894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:55.863508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:55.884217 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:55.884734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:55.887336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:55.888728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:55.889332 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:55.890839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:56.130580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:56.146825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a68ee0af-cabd-46c9-b279-5630fe9a8b95 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.287468 Aug 06 01:35:56.158550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 243/473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:55 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:57.177429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:57.178467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:57.186240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:57.186731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:57.187169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:57.187875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:57.188323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:57.188749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:57.337398 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:57.360024 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cc85c433-2e6c-43a1-bc2e-5d9768c7f288 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.188049 Aug 06 01:35:57.366993 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 231/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:57 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:58.380940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:58.381574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:58.388398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:58.388883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:58.389622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:58.390316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:58.390769 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:58.391198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:58.541659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:58.549597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-34364f2f-8e21-4554-a827-ba8c7a1d6120 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.172436 Aug 06 01:35:58.550168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 244/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:58 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:35:59.570878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:35:59.571489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:35:59.577886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:59.578374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:59.578812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:59.579503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:35:59.579961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:35:59.580388 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:35:59.710654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:35:59.718734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-32828a24-5cd9-4c94-a940-5a1eca7a61cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.151598 Aug 06 01:35:59.719318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 232/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:35:59 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:00.739606 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:00.740210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:00.747604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:00.748082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:00.748513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:00.749355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:00.749826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:00.750246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:00.885786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:00.893740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-39232afc-6b66-4008-874d-b2bbe04e009f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.157967 Aug 06 01:36:00.894298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 245/477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:00 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:01.914377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:01.914994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:01.922012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:01.922496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:01.922930 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:01.923617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:01.924068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:01.924485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:02.017117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:02.038806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:02.054368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:02.062014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-759165fd-2f02-437e-9c0e-4f428cad7d8c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.151545 Aug 06 01:36:02.062604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 233/478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:01 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:03.083142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:03.083761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:03.085753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:03.091124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:03.091610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:03.092050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:03.093618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:03.093618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:03.093618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:03.247991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:03.258218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9fba8514-ef8e-4db2-bf9e-9846d50b0f4f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.178908 Aug 06 01:36:03.259148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 246/479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:03 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:04.283656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:04.284267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:04.290492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:04.290973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:04.291404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:04.292091 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:04.292539 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:04.292962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:04.537780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:04.545401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f9515a17-1e42-42de-a1e5-d81197e015d7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.265562 Aug 06 01:36:04.545982 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 234/480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:04 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:05.566498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:05.567437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:05.573256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:05.573742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:05.574177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:05.575546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:05.576004 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:05.576431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:05.720164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:05.727676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-565ba7b7-1cff-4a91-a527-77ffdf3037e7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.165743 Aug 06 01:36:05.728247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 247/481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:05 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:06.748428 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:06.749230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:06.756050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:06.756547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:06.756984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:06.757710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:06.758319 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:06.758747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:06.895702 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:06.904126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-89846945-1161-40c1-a62d-8b38a5fcd1f6 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.160261 Aug 06 01:36:06.904717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 235/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:06 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:07.923912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:07.924752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:07.927666 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=32 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:07.931509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:07.932002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:07.932440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:07.933157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:07.934147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:07.934932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:08.078209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:08.086130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7fdad11c-4192-4a19-bbbb-0704062beee5 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.166090 Aug 06 01:36:08.086907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 248/483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:07 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:09.107416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:09.107934 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:09.114289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:09.114837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:09.115207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:09.116168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:09.116610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:09.117031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:09.254327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:09.262466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8095b70f-d31f-4ddb-ab86-ae1e5483c4d1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1270 microversion: 2.1 time: 0.158421 Aug 06 01:36:09.263118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 236/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:09 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:10.299227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:10.302933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:10.309411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:10.309914 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:10.310352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:10.311727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:10.312356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:10.312787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:10.444398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:10.452438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-36545837-2e20-4670-9246-70113dcc6421 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.171544 Aug 06 01:36:10.453492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 249/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:10 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:11.474122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:11.474827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:11.477150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:11.482415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:11.482935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:11.483383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:11.484075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:11.484532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:11.484957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:11.489703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=74 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:11.613288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:11.620917 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7022fa3f-7aa6-4342-a78b-8f0748ee8fbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150668 Aug 06 01:36:11.621519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 237/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:11 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:36:12.642166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:12.642740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:12.648658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:12.649186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:12.649633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:12.650318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:12.650779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:12.651207 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:12.784123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:12.791567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d44b6139-a168-4cba-8be1-4b1ec7ab2d08 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.153438 Aug 06 01:36:12.792138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 250/487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:12 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:13.812537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:13.813178 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:13.819704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:13.820184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:13.820620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:13.821330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:13.821786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:13.822225 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:13.952901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:13.960626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-633a4a08-e51b-436c-9f26-8933dd3ad680 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.152709 Aug 06 01:36:13.961220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 238/488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:13 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:14.980879 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:14.981512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:14.987694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:14.988180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:14.988613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:14.989333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:14.989792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:14.990215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:14.992970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=74 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:15.124519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:15.132138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ffed9e63-6ecf-4c43-aa46-5c66858a4f52 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.155042 Aug 06 01:36:15.132757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 251/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:14 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:16.153027 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:16.153676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:16.161306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:16.161831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:16.162265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:16.162957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:16.163413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:16.163886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:16.308347 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:16.316133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-76b04627-0b76-4523-a345-f14299b3220d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.166786 Aug 06 01:36:16.316876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 239/490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:16 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:17.337807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:17.338448 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:17.344309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:17.344790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:17.345253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:17.345930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:17.346377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:17.346797 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:17.476527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:17.484581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-09c44024-ff06-4dc2-8402-312fc14160a2 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150547 Aug 06 01:36:17.485189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 252/491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:17 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:18.505889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:18.506414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:18.512346 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:18.512828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:18.513299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:18.514523 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:18.514986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:18.515407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:18.646932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:18.654409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8f7d37bd-7157-429f-b80b-62f54f5c6094 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.152528 Aug 06 01:36:18.655263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 240/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:18 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:19.675248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:19.675791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:19.681755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:19.682238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:19.682670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:19.683357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:19.683813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:19.684235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:19.815398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:19.822924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-35a340bb-2c12-4f4c-80a7-5165b8174589 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.151707 Aug 06 01:36:19.823491 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 253/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:19 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:20.843541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:20.844142 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:20.850476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:20.850961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:20.851390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:20.852068 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:20.852516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:20.852991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:20.984737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:20.992369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5e7afa17-afc0-4598-89c4-cc778e1e8bad tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.152682 Aug 06 01:36:20.992925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 241/494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:20 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:22.013437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:22.014058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:22.020041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:22.020529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:22.020971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:22.021690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:22.022152 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:22.022581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:22.155770 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:22.163266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6f130f84-674e-4d56-bafb-fe07189d4164 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.153662 Aug 06 01:36:22.163841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 254/495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:22 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:23.183554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:23.184104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:23.191446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:23.191927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:23.192360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:23.193074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:23.193534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:23.193962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:23.331576 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:23.338939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e02406fd-2f60-4a1e-a150-79b7d2174869 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.159415 Aug 06 01:36:23.339498 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 242/496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:23 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:24.360089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:24.360767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:24.367168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:24.367651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:24.368084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:24.368772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:24.369261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:24.369712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:24.498930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:24.507037 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-767f7f14-52b5-4258-9328-bf085b4e4b07 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150840 Aug 06 01:36:24.507659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 255/497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:24 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:25.528281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:25.528788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:25.535747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:25.536237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:25.536674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:25.537397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:25.537852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:25.538277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:25.667204 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:25.675286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-276aec77-aa11-4c7f-a940-c81dd09735db tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150927 Aug 06 01:36:25.675848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 243/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:25 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:26.695555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:26.696166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:26.702146 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:26.702630 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:26.703070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:26.703908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:26.704366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:26.704790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:26.836572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:26.844802 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3f7259a3-f049-401d-b6d6-fa67261e43bd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.153057 Aug 06 01:36:26.845401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 256/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:26 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:27.865566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:27.866431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:27.872692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:27.873226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:27.873659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:27.874334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:27.875971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:27.876396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:28.005079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:28.012378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3a31d172-41c6-44c3-8103-c6539c089cbe tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150646 Aug 06 01:36:28.012942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 244/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:27 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:29.034280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:29.034807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:29.040938 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:29.041457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:29.041896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:29.042586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:29.043046 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:29.043477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:29.175456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:29.182891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-117c6649-c36f-448d-94a3-efd9f47b0ae4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.153198 Aug 06 01:36:29.183460 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 257/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:29 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:30.203079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:30.203913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:30.210219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:30.210700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:30.211126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:30.211803 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:30.212252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:30.212669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:30.344699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:30.352349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-00526ce3-061d-45d5-9697-a0c7eb253dbd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.153208 Aug 06 01:36:30.352905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 245/502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:30 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:31.374697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:31.375646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:31.382739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:31.383465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:31.384154 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:31.385227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:31.386118 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:31.386946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:31.536192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:31.544049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eaa23d0f-2251-432b-9ece-7810d4add647 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.173590 Aug 06 01:36:31.557077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 258/503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:31 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:32.567328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:32.568023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:32.574896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:32.575359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:32.575797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:32.576487 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:32.576945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:32.577427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:32.724971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:32.732410 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dff4b288-6eee-46bd-a737-23fd2182896a tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.170257 Aug 06 01:36:32.732974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 246/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:32 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:33.556291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "name": "network-vif-plugged", "status": "completed", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:36:33.566304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:33.566837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:33.567271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:33.579175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] Creating event network-vif-plugged:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:36:33.584474 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-e98e9b11-66fe-45b1-bd4c-ff791c2a87e2 req-9c11af0d-f038-401b-9b9a-75f9e8d9f9a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Aug 06 01:36:33.585109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 259/505] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:36:33.753988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:33.755268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:33.762020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:33.762522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:33.763023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:33.763738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:33.764240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:33.764710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:33.944212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:33.953138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-68f96cf3-185f-441b-bef5-ff418c882aa8 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.203477 Aug 06 01:36:33.965275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 247/506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:33 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:34.979314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:34.980177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:34.986876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:34.987356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:34.987804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:34.988492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:34.988944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:34.989428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:35.075148 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:35.075651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:35.083231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:35.083429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:35.083705 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:35.084401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:35.084856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:35.085309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:35.125627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:35.133818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0613b434-0b4d-46c8-9336-fbecb12ae2b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.158664 Aug 06 01:36:35.134701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 260/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:34 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:35.209382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lazy-loading 'services' on Instance uuid 8b150724-1383-42cb-8f3c-b93cf6978ed2 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:36:35.320608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c755eff4-59ed-4955-9cc9-6d1ef1032f85 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2/os-volume_attachments/e95bd376-dd57-40e9-b354-bca43745e54f" status: 202 len: 0 microversion: 2.1 time: 0.249253 Aug 06 01:36:35.321233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 248/508] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:36:35 2022] DELETE /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2/os-volume_attachments/e95bd376-dd57-40e9-b354-bca43745e54f => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:36:36.153724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:36.154469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:36.162439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:36.162927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:36.163356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:36.164041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:36.164515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:36.165037 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:36.296343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:36.304455 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8e946a2e-5ade-4314-b488-bffc0cc53798 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.154484 Aug 06 01:36:36.305021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 261/509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:36 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:37.326122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:37.326852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:37.334078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:37.334564 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:37.335006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:37.335692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:37.336147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:37.336574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:37.471738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:37.479214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8032eb55-5c18-4b76-97a1-c2f66a0485da tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.157954 Aug 06 01:36:37.479811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 249/510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:37 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:38.501318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:38.501930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:38.503953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=28 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:38.509291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:38.509777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:38.510211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:38.510903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:38.511361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:38.511784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:38.643681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:38.650983 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5bed1554-5d40-445c-8fd4-035d3d4ba187 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.154092 Aug 06 01:36:38.651539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 262/511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:38 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:39.674445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:39.675045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:39.681583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:39.682060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:39.682486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:39.683164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:39.683645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:39.684063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:39.816147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:39.823594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-16fb1325-2ee6-40c7-a10a-ad6ca82fd132 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.154461 Aug 06 01:36:39.824165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 250/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:39 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:40.844544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:40.845291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:40.851091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:40.851571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:40.852000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:40.852673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:40.853147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:40.853567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:40.982825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:40.990984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-67a725d0-5249-4e36-accb-8e8e9fec8a46 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1258 microversion: 2.1 time: 0.150810 Aug 06 01:36:40.991801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 263/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:40 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:42.012181 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:42.012862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:42.015468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=28 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:42.021211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.021709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.022149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.022948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.023408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.023918 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.028115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:42.191645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:42.201398 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0f4ba159-0bbc-4ad9-af12-525eab99af1d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1443 microversion: 2.1 time: 0.193430 Aug 06 01:36:42.222720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 251/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:42 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:42.227005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:42.227497 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:42.237100 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.237592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.238036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.238737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.239194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.239620 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.405796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:42.414697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b15c4382-de2e-4c30-b581-0afed5a01f10 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1443 microversion: 2.1 time: 0.191795 Aug 06 01:36:42.415614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 264/515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:42 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1443 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:42.821297 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:42.821798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:42.827820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.828554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.829097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.829804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:42.830437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:42.831031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:42.863878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:36:42.993936 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-812d6409-5d0b-45e1-9671-6cb6ab44b031 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 204 len: 0 microversion: 2.1 time: 0.176401 Aug 06 01:36:42.994819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 252/516] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:36:42 2022] DELETE /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:36:43.003246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:43.004195 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:43.010413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:43.011126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:43.011731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:43.012597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:43.013073 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:43.013812 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:43.173788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:43.184361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bb064aa7-49a4-47fc-b7fd-885d1cf0d072 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.185137 Aug 06 01:36:43.185014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 265/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:42 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:36:44.210344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:44.211856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:44.218948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:44.220097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:44.220534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:44.221602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:44.222093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:44.222442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:44.365788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:44.373979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4c0291bf-73f5-4d0a-b33f-245d7c653037 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.171488 Aug 06 01:36:44.374776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 253/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:44 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:44.787601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:36:44.796971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:44.798253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:44.798696 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:44.810123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] Creating event network-changed:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:36:44.815996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-1f7212a0-ce04-4e87-940c-d48913635046 req-306a6698-95d0-4837-a22b-027ffdf43d68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Aug 06 01:36:44.816590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 266/519] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:36:45.396750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:45.398261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:45.405823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:45.406839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:45.407380 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:45.408366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:45.409039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:45.409568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:45.556473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:45.564745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-574f882f-3509-4680-a5c6-b37491c5a8f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.171965 Aug 06 01:36:45.565462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 254/520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:45 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:46.586325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:46.587034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:46.593100 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:46.593594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:46.594592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:46.595533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:46.595997 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:46.596426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:46.600450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=88 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:46.725706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:46.733161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8f68d981-3122-47de-a0c3-01d644d49c17 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.151310 Aug 06 01:36:46.733733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 267/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:46 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:47.755763 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:47.756399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:47.762470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:47.762953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:47.763413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:47.764101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:47.764551 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:47.764971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:47.893985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:47.901480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6a69803c-d6db-4a19-835b-6dc72aba4060 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.149817 Aug 06 01:36:47.902047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 255/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:47 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:48.923529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:48.924105 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:48.930193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:48.930691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:48.931135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:48.931839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:48.932301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:48.932739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:49.232055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:49.240008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5d8756c0-c05e-474b-8517-1e8da15c115a tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1512 microversion: 2.1 time: 0.320720 Aug 06 01:36:49.240567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 268/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:48 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:50.044980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b150724-1383-42cb-8f3c-b93cf6978ed2", "name": "network-vif-deleted", "tag": "196e367b-8037-4328-8e2d-49d83b53c6bf"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:36:50.055446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.055922 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.056349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.071867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] Creating event network-vif-deleted:196e367b-8037-4328-8e2d-49d83b53c6bf for instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 on hv-cinder-85200 Aug 06 01:36:50.076967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-145563ff-3336-4ad1-9a0d-2458bc0a62e8 req-176c7a75-ef1b-4a9a-a841-8a7dc4403a44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Aug 06 01:36:50.077634 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 256/524] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:36:50.261784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:50.263374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:50.270520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.272305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.272791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.273610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.274465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.274913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.308612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.309228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.309740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.310303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lazy-loading 'fault' on Instance uuid 8b150724-1383-42cb-8f3c-b93cf6978ed2 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:36:50.355228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:50.396816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e85f39ae-ea56-4e1c-b220-f134e2eb0cd5 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 200 len: 1308 microversion: 2.1 time: 0.135768 Aug 06 01:36:50.396816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 269/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:50 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:50.567933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-943124001", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:36:50.619574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] validate_networks() for None {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:36:50.904314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:36:50.904837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:36:50.905537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:36:50.906023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:36:50.906482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:36:50.916332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.916811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.917298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.918015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:50.918465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:50.918886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:50.936176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Getting quotas for project c56b8479508d4ca994d5f3035c8d18e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:36:50.940886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Getting quotas for user 5471e0d1dbfd4858ab89950cc52c639b and project c56b8479508d4ca994d5f3035c8d18e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:36:50.951620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:36:50.954156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:36:51.001014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4c4051f1-8b44-4271-8cd3-1b682d39520d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436509 Aug 06 01:36:51.001962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 257/526] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:36:51.012445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a4f4c545-cd54-4e8e-a078-0c5ae24edba1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:51.012978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a4f4c545-cd54-4e8e-a078-0c5ae24edba1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:51.068882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a4f4c545-cd54-4e8e-a078-0c5ae24edba1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:51.075535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a4f4c545-cd54-4e8e-a078-0c5ae24edba1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1214 microversion: 2.1 time: 0.066895 Aug 06 01:36:51.076101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 270/527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:51 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:51.416515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:51.417227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: 8b150724-1383-42cb-8f3c-b93cf6978ed2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:51.425039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:51.425554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:51.426039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:51.426795 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:51.427383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:51.427813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:51.441437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] HTTP exception thrown: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Request method failure captured: Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 HTTP/1.1 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cUBEyVI-W7litMxPk784ccrLa7KBnyYE_RhCQg00PzH5bOVW6Cyl4OeKpFJQBGOrBtdHY_tKt5QkUgsnfjOxwkMM77iSiKIBqt156G3F9Wt6Mky0DJRbk2G2a7ALtetPzAk7QAqNwzwy54xvxgH-FAvxnTtYCscyjwzVxP_jV0M7MY Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: e50641dc16fa4187b5f0d4f936d34d53 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:36:51.443084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e50641dc16fa4187b5f0d4f936d34d53"}]}] Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: e50641dc16fa4187b5f0d4f936d34d53 Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesSnapshotTestJSON-2123842345-project Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: c938a575a2704078a82fe6df941884dc Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesSnapshotTestJSON-2123842345-project Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. Aug 06 01:36:51.444582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8b150724-1383-42cb-8f3c-b93cf6978ed2'} Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:36:51.445463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. Aug 06 01:36:51.446666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:36:51.447886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Returning 404 to user: Instance 8b150724-1383-42cb-8f3c-b93cf6978ed2 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:36:51.447886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7ecab3c7-8184-4b0e-8876-9dd377db7e72 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2" status: 404 len: 111 microversion: 2.1 time: 0.032406 Aug 06 01:36:51.447886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 258/528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:51 2022] GET /compute/v2.1/servers/8b150724-1383-42cb-8f3c-b93cf6978ed2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:52.096900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:52.097732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:52.103726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:52.104419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:52.105018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:52.105739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:52.106199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:52.106626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:52.169773 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:52.178755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4f4b1497-68bd-4338-93b8-5c5b35fb8ffa tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1274 microversion: 2.1 time: 0.086715 Aug 06 01:36:52.179325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 271/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:52 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:36:53.199709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:53.200320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:53.207231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:53.207709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:53.208138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:53.208814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:53.209292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:53.209708 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:53.272361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:53.279816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-aa92cfce-e24c-4994-9b5c-8f03a7091f72 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1274 microversion: 2.1 time: 0.083950 Aug 06 01:36:53.280376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 259/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:53 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:54.300996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:54.301624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:54.307553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:54.308035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:54.308462 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:54.309166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:54.309616 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:54.310044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:54.370801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:54.378782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e20132be-aaf5-468c-952f-ee9a5c4243a2 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1274 microversion: 2.1 time: 0.081759 Aug 06 01:36:54.379338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 272/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:54 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:36:55.401470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:55.402094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:55.409562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:55.410043 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:55.410477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:55.411156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:55.411602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:55.412021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:55.474774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:55.482283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4550cf72-309b-4280-b0f3-2b80254cb27d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1274 microversion: 2.1 time: 0.084678 Aug 06 01:36:55.482838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 260/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:55 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:56.505366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:56.505975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:56.512679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:56.514365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:56.514968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:56.515836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:56.516457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:56.517959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:56.598744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:56.606236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-50dc25fc-8581-4d6f-acdb-5ead6ca45ca9 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1272 microversion: 2.1 time: 0.106361 Aug 06 01:36:56.606815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 273/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:56 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:57.629256 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:57.630927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:57.639797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:57.640700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:57.641383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:57.643290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:57.643751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:57.644347 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:57.897815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:57.906166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4d99f855-7186-41b3-aa9e-362c695b57e1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.282068 Aug 06 01:36:57.907048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 261/534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:57 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:36:58.277875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28eba2fa-42dc-4f73-84fc-1239f0d2d4c3", "tag": "52cbd280-390d-4da9-8685-9dd42ecfda6d"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:36:58.292345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:58.293092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:58.293591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:58.311073 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] Creating event network-changed:52cbd280-390d-4da9-8685-9dd42ecfda6d for instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 on hv-cinder-85200 Aug 06 01:36:58.318168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-691eb746-eb89-4e9f-a404-7f7cb9696f6d req-1f8bc319-b843-48c4-a115-426c7d6cf929 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Aug 06 01:36:58.318772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 274/535] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:36:58.930229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:36:58.930864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:36:58.937356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:58.937836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:58.938266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:58.939720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:36:58.940317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:36:58.940736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:36:59.436007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:36:59.446471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e8c1925c-8bf6-4a94-803d-134502d194d3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.522018 Aug 06 01:36:59.447296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 262/536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:36:58 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:00.467742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:00.468445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:00.475616 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:00.476127 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:00.476540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:00.477297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:00.477765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:00.478199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:00.610027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:00.618547 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-593eafa4-aa88-44ba-9350-17293ccd2f5a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.154917 Aug 06 01:37:00.619140 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 275/537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:00 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:01.638382 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:01.638895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:01.641300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:01.642648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:01.648531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:01.649012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:01.649471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:01.650153 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:01.650605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:01.651025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:01.779175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:01.786912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dbf152d5-c45a-4987-9330-ca3977f4a7dc tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.152463 Aug 06 01:37:01.787492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 263/538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:01 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:02.807483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:02.808124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:02.810180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:02.815980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:02.816467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:02.816899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:02.817645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:02.818098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:02.818519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:02.949796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:02.957838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-06a71f7b-3230-4cad-81c3-6a116e35f078 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.154196 Aug 06 01:37:02.958394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 276/539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:02 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:03.978828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:03.979431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:03.986406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:03.986884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:03.987317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:03.987995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:03.988447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:03.988867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:04.124387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:04.132515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3562f405-b4cb-4c88-8b6c-d138c5fe854d tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.157452 Aug 06 01:37:04.133022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 264/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:03 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:05.152363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:05.152976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:05.159306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:05.159803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:05.160246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:05.160945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:05.161442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:05.161872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:05.291565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:05.299931 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d9c44bf3-9610-4737-b109-c8e1d76b5bb1 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.151585 Aug 06 01:37:05.300724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 277/541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:05 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:06.322521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:06.323129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:06.330203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:06.330805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:06.331250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:06.332042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:06.332608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:06.333136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:06.465182 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:06.473349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e7b50325-b232-45ed-8a31-e8672be5d68e tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.154635 Aug 06 01:37:06.473923 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 265/542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:06 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:06.689132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1274021991", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "networks": [{"uuid": "49f87cbe-59cb-43e3-ac6d-eda0b4e45cf9"}]}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:06.743546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] validate_networks() for [('49f87cbe-59cb-43e3-ac6d-eda0b4e45cf9', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:37:07.092473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:37:07.092905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:37:07.093415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:37:07.093829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:37:07.094246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:37:07.104478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:07.104901 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:07.105368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:07.106091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:07.106546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:07.106973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:07.124347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Getting quotas for project e50641dc16fa4187b5f0d4f936d34d53. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:37:07.129014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Getting quotas for user c938a575a2704078a82fe6df941884dc and project e50641dc16fa4187b5f0d4f936d34d53. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:37:07.140759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:37:07.143297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:37:07.188623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-49255c3d-61e7-4fa8-92e9-48e41417ff05 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503956 Aug 06 01:37:07.189298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 278/543] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:37:07.200383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-14b617a7-8e12-496f-abb8-7148cda94ed1 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:07.201235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-14b617a7-8e12-496f-abb8-7148cda94ed1 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:07.254739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14b617a7-8e12-496f-abb8-7148cda94ed1 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:07.261403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-14b617a7-8e12-496f-abb8-7148cda94ed1 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1219 microversion: 2.1 time: 0.064848 Aug 06 01:37:07.261972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 266/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:07 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:07.494913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:07.495706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:07.502704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:07.503361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:07.503884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:07.504643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:07.505128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:07.505746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:07.646658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:07.654007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c843265d-c6f7-44db-bf57-b74a01415ad8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.163920 Aug 06 01:37:07.654511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 279/545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:07 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:08.282589 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:08.283139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:08.289594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:08.290074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:08.290506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:08.291193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:08.291644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:08.292157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:08.355137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:08.363222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-930bc54d-fa7f-48f1-aaf6-89e5e4423649 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1223 microversion: 2.1 time: 0.084659 Aug 06 01:37:08.363788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 267/546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:08 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:08.675044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:08.675564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:08.677649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:08.683076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:08.683552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:08.683981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:08.684661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:08.685136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:08.685587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:08.913946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:08.923570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7196377f-4628-4fb1-86a7-478608326fe7 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.253196 Aug 06 01:37:08.924328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 280/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:08 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:09.383631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:09.384243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:09.390932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:09.392327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:09.392948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:09.393706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:09.394314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:09.394903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:09.521360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:09.529710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-541547e2-f8f1-4f35-bb80-91ae0ddb6609 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1279 microversion: 2.1 time: 0.149864 Aug 06 01:37:09.530529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 268/548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:09 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:09.943887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:09.944503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:09.951190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:09.951685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:09.952128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:09.952831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:09.953316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:09.953753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:10.160810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:10.169080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f0a2b7c7-51f1-41fd-9d95-39c8cddd04ac tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.228930 Aug 06 01:37:10.169750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 281/549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:09 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:10.519050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:10.519627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:10.526347 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:10.526908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:10.527574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:10.528377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:10.528919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:10.529464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:10.532554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:10.556798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a68b05af-8e34-4bc2-974c-c8410b96e867 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/ips" status: 200 len: 146 microversion: 2.1 time: 0.042421 Aug 06 01:37:10.557701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 269/550] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:37:10 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:10.558524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:10.559208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:10.566376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:10.566879 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:10.567322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:10.568108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:10.568568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:10.569000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:10.769631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:10.777247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a43601f6-e337-44e0-8ae6-d7ed851286f0 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.229705 Aug 06 01:37:10.777817 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 282/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:10 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:11.192171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:11.193138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:11.200342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:11.200843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:11.201309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:11.202306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:11.202875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:11.203348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:11.246295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7", "tag": "ca3ff6d9-7875-4d0b-9327-2177398ac8fa"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:11.258902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:11.260503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:11.261339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:11.280400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] Creating event network-changed:ca3ff6d9-7875-4d0b-9327-2177398ac8fa for instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 on hv-cinder-85200 Aug 06 01:37:11.288330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-7774925d-8aef-494b-8141-8fb7aede17d4 req-8ac9cd49-683e-4e8a-abf5-4c53afd18f3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Aug 06 01:37:11.289557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 283/552] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:37:11.428963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:11.436425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e9a67d99-f9dd-4642-8708-af149bb6659b tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.250262 Aug 06 01:37:11.436988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 270/553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:11 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:11.800977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:11.801991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:11.808716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:11.809318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:11.809826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:11.810855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:11.811545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:11.812162 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:11.960251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:11.968367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c4f304d0-3fbe-47d3-85bc-96c08d0ed13c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.172934 Aug 06 01:37:11.968944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 284/554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:11 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:12.457819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:12.458432 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:12.460767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:12.466547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:12.467035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:12.467477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:12.468170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:12.468631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:12.469081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:12.596962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:12.604326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e0f9cbcc-345c-4e38-a60d-a51489a431c0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.150956 Aug 06 01:37:12.604894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 271/555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:12 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:12.988649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:12.989286 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:12.995398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:12.995857 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:12.996287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:12.996961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:12.997435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:12.997854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:13.132296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:13.140152 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cd847b42-2322-47dc-8a5d-08ba2f8e98f6 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.155823 Aug 06 01:37:13.140778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 285/556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:12 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:13.209884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eba2fa-42dc-4f73-84fc-1239f0d2d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "52cbd280-390d-4da9-8685-9dd42ecfda6d"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:13.219592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:13.220174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:13.220584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:13.231786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] Creating event network-vif-plugged:52cbd280-390d-4da9-8685-9dd42ecfda6d for instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 on hv-cinder-85200 Aug 06 01:37:13.237443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-945b062f-4e02-47b5-add1-90316db67260 req-b91b951e-5ec8-45e7-b82d-aa4a34f904aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031239 Aug 06 01:37:13.238039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 272/557] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:13.625187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:13.626420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:13.632290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:13.632778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:13.633264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:13.633952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:13.634411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:13.634838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:13.650537 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:13.762863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:13.771091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f7f9ee75-b236-4071-a357-e635d02553e8 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.149750 Aug 06 01:37:13.771659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 286/558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:13 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:13.993118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a340c819-903b-46ce-990e-762d20d85a20"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:13.995510 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:14.002141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.002617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.003048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.003719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.004168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.004586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.163849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:14.164470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:14.170367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.170855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.171298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.171985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.172948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.173407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.301368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:14.308782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-06e08a1d-7dbd-49e9-bbbc-6e3e5f8df419 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.148920 Aug 06 01:37:14.309384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 287/559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:14 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:14.791426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:14.792032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:14.798606 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.799089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.799525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.800205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:14.800652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:14.801094 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:14.932510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:14.939874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fcb481e0-287f-4d8a-b80c-eedb1a7cad8c tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.152269 Aug 06 01:37:14.940473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 288/560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:14 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:15.329981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:15.330603 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:15.336511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:15.336998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:15.337470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:15.338159 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:15.338627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:15.339058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:15.469920 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:15.477348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2691803e-ea1f-4828-9261-dbe6ee209086 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.151856 Aug 06 01:37:15.477912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 289/561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:15 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:15.877935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4e16e5c3-d9b3-4719-9ebf-0f140bdc5e64 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.889621 Aug 06 01:37:15.878817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 273/562] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:37:13 2022] POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments => generated 194 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:15.959954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:15.960505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:15.966353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:15.966838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:15.967289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:15.967991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:15.968503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:15.968842 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:16.417806 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:16.425235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9e0c6584-0767-417e-b6d2-1e8d6c1ab879 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.469135 Aug 06 01:37:16.425806 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 290/563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:15 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:16.499239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:16.499956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:16.506362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:16.506844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:16.507275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:16.507949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:16.508400 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:16.508818 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:16.639109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:16.647023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7fc01348-08ce-46e2-8a1c-4e7ea7259536 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.152465 Aug 06 01:37:16.647588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 274/564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:16 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:17.445347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:17.445994 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:17.447843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:17.448512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:17.454525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:17.455008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:17.455495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:17.456133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:17.456587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:17.457012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:17.588021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:17.597257 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a97909c3-1393-4d13-91db-421b2de40b00 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.155752 Aug 06 01:37:17.597841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 291/565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:17 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:17.666868 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:17.667480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:17.669878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:17.675080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:17.675560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:17.675991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:17.676670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:17.677165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:17.677588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:17.808654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:17.817241 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9b0e1754-b3be-4c90-97c9-dff47140cc89 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.154107 Aug 06 01:37:17.817803 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 275/566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:17 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:18.617988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:18.618648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:18.624496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:18.624973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:18.625437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:18.626271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:18.626722 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:18.627144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:18.756233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:18.763593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a6925383-dec9-495a-8534-2e67bad63963 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1314 microversion: 2.1 time: 0.149697 Aug 06 01:37:18.764184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 292/567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:18 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:18.837591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:18.838214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:18.844819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:18.845277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:18.845716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:18.846436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:18.846849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:18.847331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:18.977107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:18.984457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b28738d1-6f57-4462-a20c-d8756f9138bb tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.150745 Aug 06 01:37:18.985029 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 276/568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:18 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:19.524482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:19.524970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:19.530892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.531373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.532479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:19.533200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.533650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.534071 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:19.557090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-279113db-3e7f-468f-9027-c83eb33af7f4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/ips" status: 200 len: 150 microversion: 2.20 time: 0.036459 Aug 06 01:37:19.557644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 293/569] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Aug 6 01:37:19 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:37:19.784280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:19.784820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:19.794413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.794413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.794413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:19.794413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.794804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.794804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:19.932064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:19.940072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9bdbb2cb-dc6b-49e7-bb2b-af1cb4d00b6f tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1463 microversion: 2.1 time: 0.160296 Aug 06 01:37:19.940660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 277/570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:19 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:19.985522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:19.986028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:19.992279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.992761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.993226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:19.993913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:19.994367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:19.994796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.005369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:20.006041 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:20.011991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:20.012521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:20.012958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.013677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:20.014131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:20.014559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.022018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:37:20.097806 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3a2198c4-eb49-4f65-9605-48ef0170df97 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "DELETE /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 204 len: 0 microversion: 2.1 time: 0.116364 Aug 06 01:37:20.098402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 294/571] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:37:19 2022] DELETE /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:37:20.106655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:20.107353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:20.113801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:20.114294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:20.114743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.115433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:20.115893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:20.118259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.147894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:20.155536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-179714e6-e9fa-4452-86b1-a15b70978a94 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.154749 Aug 06 01:37:20.156105 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 278/572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:19 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:20.255016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:20.266028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-08cd3989-3693-4177-967f-a6c7975e9f3a tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1469 microversion: 2.1 time: 0.163194 Aug 06 01:37:20.268025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 295/573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:20 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:20.393137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7", "name": "network-vif-plugged", "status": "completed", "tag": "ca3ff6d9-7875-4d0b-9327-2177398ac8fa"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:20.403238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:20.403717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:20.404247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:20.419955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] Creating event network-vif-plugged:ca3ff6d9-7875-4d0b-9327-2177398ac8fa for instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 on hv-cinder-85200 Aug 06 01:37:20.425402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-7a0130d7-059a-4d8a-b5e2-88a7157c433c req-485c1b8f-36ca-450b-b45d-99710bfcb9d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 Aug 06 01:37:20.426011 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 279/574] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:21.179770 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:21.180303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:21.186322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:21.186801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:21.187235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:21.187940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:21.188818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:21.189218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:21.290603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:21.291274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:21.306193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:21.306677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:21.307108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:21.307799 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:21.308340 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:21.308826 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:21.319373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:21.326825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f510fb7b-49e9-4ee0-9f6b-01516d280079 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.150986 Aug 06 01:37:21.327395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 296/575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:21 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:21.444039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:21.451545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-23899a7f-ce79-434c-b904-ae5113a7cdee tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1469 microversion: 2.1 time: 0.165112 Aug 06 01:37:21.452111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 280/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:21 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:22.347861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:22.348412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:22.354380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.354873 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.355307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.355997 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.356456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.356884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.473216 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:22.473935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:22.480595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.481117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.481570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.482277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.482739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.483170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.485185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:22.492811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4efe470f-9ef4-482f-a814-8831c75c3bd2 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.149470 Aug 06 01:37:22.493419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 297/577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:22 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:22.543349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:22.543885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:22.549819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.550813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.551259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.551958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.552419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.552850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.576107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lazy-loading 'flavor' on Instance uuid 4ed60127-a6a5-49bb-ace7-03495a61fcf2 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:37:22.617662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:22.625956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-30b24e0a-45af-4541-9570-87c189af42cd tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1469 microversion: 2.1 time: 0.156598 Aug 06 01:37:22.626637 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 281/578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:22 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:22.752980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-271226bf-b7e8-43c5-94a9-75d520006157 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/action" status: 202 len: 0 microversion: 2.20 time: 0.213305 Aug 06 01:37:22.753625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 298/579] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Aug 6 01:37:22 2022] POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 01:37:22.762046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:22.762653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:22.769164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.769650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.770086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.770772 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:22.771228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:22.771652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:22.902191 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:22.910288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:22.911809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:22.912945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e07660bd-a088-4c57-b0aa-57b118817a1c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.154900 Aug 06 01:37:22.913531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 282/580] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:22 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:37:23.514343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:23.515035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:23.521401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.521882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.522318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:23.522995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.523443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.523860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:23.647517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:23.648150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:23.651116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:23.653498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:23.654751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.655529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.655967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:23.656657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.657139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.657565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:23.661230 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-277548b3-7f20-49dd-92fe-22f8d267cee9 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.151025 Aug 06 01:37:23.661814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 299/581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:23 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:23.784986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:23.792443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-305d9799-a746-4d24-98c6-a7065b4db924 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1469 microversion: 2.1 time: 0.148710 Aug 06 01:37:23.793011 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 283/582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:23 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:23.935887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:23.936757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:23.944408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.944888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.945350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:23.946045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:23.946494 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:23.946949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.078862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:24.087423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:24.088925 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:24.090097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a8dbdf32-863c-491d-a8b7-6b98cef311d5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.158406 Aug 06 01:37:24.090653 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 300/583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:23 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:24.639196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eba2fa-42dc-4f73-84fc-1239f0d2d4c3", "name": "network-vif-deleted", "tag": "52cbd280-390d-4da9-8685-9dd42ecfda6d"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:24.648701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:24.649376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:24.649738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.661559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] Creating event network-vif-deleted:52cbd280-390d-4da9-8685-9dd42ecfda6d for instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 on hv-cinder-85200 Aug 06 01:37:24.666337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-6e149f69-c72c-47a5-a19b-66a94139ff4c req-4879d995-9f08-4244-bae3-0a74a4f22ed9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 Aug 06 01:37:24.667113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 284/584] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:24.682703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:24.683313 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:24.690864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:24.691596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:24.692030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.692723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:24.693203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:24.693629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.814245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:24.814942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:24.821355 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:24.821845 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:24.822284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.822976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:24.823437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:24.823866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:24.831169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:24.838746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ebcfe0a9-f2b8-4cd6-a933-7f828aab146e tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1319 microversion: 2.1 time: 0.160146 Aug 06 01:37:24.839405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 301/585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:24 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:24.887423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:24.896375 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2c3c681d-4ff6-45c3-855a-36970f5e6448 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1427 microversion: 2.1 time: 0.086374 Aug 06 01:37:24.897093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 285/586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:24 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:25.116102 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:25.116910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:25.122942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.123507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.124009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.125109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.125599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.126019 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.258399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:25.266206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:25.268495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:25.269690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3dc8b660-c541-42c6-a2b8-28ea0a8f29fb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.158273 Aug 06 01:37:25.270248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 302/587] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:25 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:25.859826 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:25.860440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:25.867225 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.867707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.868140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.868821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.869314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.869744 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.917342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:25.917951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:25.924160 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.924692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.925166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.925948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.926437 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.926823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.958555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:25.959039 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:25.959476 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:25.959923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lazy-loading 'fault' on Instance uuid 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:37:26.012674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.020785 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-24ff6b09-976b-4330-a7bb-acbd3fd731c3 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1304 microversion: 2.1 time: 0.107194 Aug 06 01:37:26.021717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 303/588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:25 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:26.042302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.044619 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:26.051198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a952ec92-245b-4a0e-b0be-8aee29575a3d tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1507 microversion: 2.1 time: 0.195252 Aug 06 01:37:26.051787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 286/589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:25 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:26.071599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b72205d-5707-455f-bb9b-1c1a20c5918a", "device": "/dev/sdb"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:26.074642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:26.081172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.081916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.082358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.083063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.083524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.083962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.294093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:26.294713 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:26.302507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.303059 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.303506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.304220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.304676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.305164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.451578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.460302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.461846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.463009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-eb323593-9222-4877-b02a-f5d3e4bc603c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.172937 Aug 06 01:37:26.463584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 287/590] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:26 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:37:26.645963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:26.652112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.652592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.653021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.715620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Going to try to stop instance {{(pid=124314) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 01:37:26.759712 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dfa1acab-7e1d-4620-865d-48ad0eaca644 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.119007 Aug 06 01:37:26.760323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 288/591] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:37:26 2022] POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 01:37:26.770789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:26.771505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:26.777893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.778376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.778825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.779768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:26.780224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:26.780774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:26.885572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3c05d6d1-3699-41b0-8899-09da96d1c01c tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "POST /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817675 Aug 06 01:37:26.891177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 304/592] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:37:26 2022] POST /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:26.937850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:26.950318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6caf9eac-dfed-46c9-b1ff-665f8931c638 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.185180 Aug 06 01:37:26.950626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 289/593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:26 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:27.042977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:27.043675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:27.050474 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.050958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.051388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.052076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.052544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.052956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.082684 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.083166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.083599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.084038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lazy-loading 'fault' on Instance uuid 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:37:27.126680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5471e0d1dbfd4858ab89950cc52c639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b8479508d4ca994d5f3035c8d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:27.134108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e6600b77-2bd7-4d55-9cb0-7de9d66304d0 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 200 len: 1304 microversion: 2.1 time: 0.095732 Aug 06 01:37:27.134600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 305/594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:27 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:27.488369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:27.488977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:27.495148 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.495631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.496062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.496744 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.497247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.497670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.626445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:27.634828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:27.636313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:27.637490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9dde9eb1-7748-4383-b48e-2bc6307c9307 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.153186 Aug 06 01:37:27.638043 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 290/595] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:27 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:27.971693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:27.972306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:27.978715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.979194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.979631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:27.980313 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:27.980765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:27.981289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:28.109507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:28.117765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f7053ca5-25a0-44bc-bc49-add598f99c28 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.150081 Aug 06 01:37:28.118330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 306/596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:27 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:28.154563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:28.155166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] [instance: 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:28.162047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:28.162588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:28.163022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:28.163774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:28.164233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:28.164661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:28.178533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] HTTP exception thrown: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Request method failure captured: Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 HTTP/1.1 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cWrDP4W3Jac26SK7HZ0UNfbJg40gHvC0K-9FfFU2x7VhgbViYmewVsKd65D5ibqctrEnRWuibeo2QQFTmZMlI_74kRPOVTx9mvtis4_EKgt4fNBmd4ShEYRPoZB-MquyOnOwWHmrIefHouaIt-nPeb0ejq0EBxyIMfwDU5nFiuSwpU Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: c56b8479508d4ca994d5f3035c8d18e8 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-VolumesNegativeTest-1939485295 Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:37:28.180087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c56b8479508d4ca994d5f3035c8d18e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b8479508d4ca994d5f3035c8d18e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c56b8479508d4ca994d5f3035c8d18e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b8479508d4ca994d5f3035c8d18e8"}]}] Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-VolumesNegativeTest-1939485295 Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: c56b8479508d4ca994d5f3035c8d18e8 Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-VolumesNegativeTest-1939485295 Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-VolumesNegativeTest-1939485295-project Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 5471e0d1dbfd4858ab89950cc52c639b Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-VolumesNegativeTest-1939485295-project Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. Aug 06 01:37:28.181733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '28eba2fa-42dc-4f73-84fc-1239f0d2d4c3'} Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:37:28.182733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. Aug 06 01:37:28.183980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:37:28.185221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] Returning 404 to user: Instance 28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:37:28.185221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3d723cfe-e9b9-4454-9f61-483ac0f85a52 tempest-VolumesNegativeTest-1939485295 tempest-VolumesNegativeTest-1939485295-project] 10.222.0.26 "GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3" status: 404 len: 111 microversion: 2.1 time: 0.030891 Aug 06 01:37:28.185221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 291/597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:28 2022] GET /compute/v2.1/servers/28eba2fa-42dc-4f73-84fc-1239f0d2d4c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:37:28.662563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:28.663371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:28.670246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:28.670903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:28.671413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:28.672179 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:28.672749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:28.673271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:28.815196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:28.823271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:28.824893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:28.826083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-aadcd7ef-a57c-4e6a-9c47-71be8c91460c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.168326 Aug 06 01:37:28.826626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 307/598] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:28 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:29.139590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:29.140152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:29.147408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:29.147903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:29.148480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:29.149242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:29.149704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:29.150127 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:29.296449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:29.305804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-82e4b1e1-b830-4244-ac27-7a366a6447b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.170076 Aug 06 01:37:29.306383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 292/599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:29 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:29.849241 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:29.849962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:29.856330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:29.856801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:29.857268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:29.857952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:29.858481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:29.858913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:30.006441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:30.017592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:30.020052 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:30.021330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8ed4f0ae-8eac-4293-9ea5-52c297d41977 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.176373 Aug 06 01:37:30.021835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 308/600] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:29 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:30.334906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:30.335503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:30.343102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:30.343641 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:30.344083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:30.344788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:30.345292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:30.345720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:30.499503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:30.509647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-44ff6a1b-acd3-44d4-a643-5b891906382c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.184888 Aug 06 01:37:30.510243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 293/601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:30 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:31.045441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:31.045988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:31.053517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:31.054001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:31.054431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:31.055125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:31.055756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:31.056184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:31.222338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:31.230233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:31.231855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:31.233026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d77e6bd3-572f-45fd-9ac0-93de87a17e7e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.191776 Aug 06 01:37:31.233598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 309/602] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:31 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:31.530831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:31.531436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:31.538552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:31.539034 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:31.539503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:31.540185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:31.540661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:31.541107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:31.669384 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:31.677480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f76a94db-734a-41a9-aca6-c3fae0bcdf94 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.150453 Aug 06 01:37:31.678055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 294/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:31 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:37:32.257261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:32.257885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:32.264866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:32.265902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:32.266352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:32.267060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:32.267517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:32.268631 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:32.411529 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:32.419765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:32.421763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:32.422940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-46537f8e-f1a3-4b93-87dd-fad0bf7dc55e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.171096 Aug 06 01:37:32.423498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 310/604] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:32 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:32.700506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:32.701145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:32.708173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:32.708762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:32.709290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:32.710120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:32.710597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:32.711185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:32.916162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:32.925568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-80b1b330-5bb7-495a-99f3-447d89f1f40b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.229400 Aug 06 01:37:32.926360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 295/605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:32 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:33.447005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:33.447689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:33.454662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:33.455206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:33.456092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:33.457137 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:33.457602 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:33.458033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:33.599311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:33.607763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:33.609408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:33.610573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-05c5a781-e56a-4e7c-8d1d-7a26f1427cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.167589 Aug 06 01:37:33.611141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 311/606] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:33 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:33.946864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:33.947556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:33.954080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:33.954574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:33.955014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:33.956603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:33.957464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:33.958218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:34.094419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:34.102643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-93abb1d1-0449-4b6e-914b-54f59ccef7cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.159600 Aug 06 01:37:34.103229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 296/607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:33 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:34.634098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:34.634618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:34.641782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:34.642264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:34.642700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:34.643385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:34.643836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:34.644253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:34.779161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:34.788725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:34.790308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:34.791467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bbaf9acf-bbb6-4031-beeb-e592454d127b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.161345 Aug 06 01:37:34.792023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 312/608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:34 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:35.123777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:35.124306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:35.130752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:35.131234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:35.131667 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:35.132346 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:35.132796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:35.133253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:35.266228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:35.274957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-34726bcd-14f5-42ef-aad8-2ff0dba9e1f4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.155048 Aug 06 01:37:35.275530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 297/609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:35 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:35.814266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:35.814875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:35.822782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:35.823349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:35.823788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:35.824471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:35.824922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:35.825378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:35.953504 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:35.961458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:35.962961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:35.964146 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f6a1dcd9-2c81-44fa-a57c-669806cfc7a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.153771 Aug 06 01:37:35.964711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 313/610] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:35 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:36.297599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:36.298214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:36.305242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:36.305728 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:36.306165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:36.306849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:36.307302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:36.307729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:36.436490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:36.444893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8fc5372f-f5d0-4a0b-97fe-34d49dbdb0ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.151185 Aug 06 01:37:36.445485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 298/611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:36 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:36.986003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:36.986607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:36.994096 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:36.994583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:36.995022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:36.995713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:36.996166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:36.996591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:37.011231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:37.128429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:37.136542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:37.138071 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:37.139223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-08222361-9f24-4d30-b980-a979073993dc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.157093 Aug 06 01:37:37.139777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 314/612] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:36 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:37.466748 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:37.467356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:37.474891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:37.475366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:37.475793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:37.476467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:37.476916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:37.477367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:37.611429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:37.619836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9c524685-4a10-4325-851b-2d99a33ffdf7 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.156855 Aug 06 01:37:37.620386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 299/613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:37 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:38.162614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:38.163336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:38.169735 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:38.170225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:38.170663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:38.171357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:38.171819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:38.172248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:38.303453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:38.311389 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:38.312901 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:38.314085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1a6ac5c2-54e4-4d76-aaa9-6bf63f5b5c21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.155707 Aug 06 01:37:38.314670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 315/614] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:38 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:38.641505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:38.642129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:38.649251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:38.649758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:38.650188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:38.650900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:38.651482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:38.651950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:38.796114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:38.803988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4073d486-0d31-4efd-bd61-5537e5d7fb4c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.166467 Aug 06 01:37:38.804561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 300/615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:38 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:39.337343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:39.337892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:39.340217 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:39.345480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:39.345967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:39.346404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:39.347089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:39.347661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:39.348088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:39.478118 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:39.485958 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:39.488108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:39.489469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4c4d92ec-c297-46d7-97fb-353d84a44a2c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.156104 Aug 06 01:37:39.490029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 316/616] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:39 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:39.825255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:39.825868 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:39.832570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:39.833086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:39.833521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:39.834218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:39.834678 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:39.835107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:39.965488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:39.973837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1d25273f-0cf4-4056-bb0e-8f9488e945dd tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.152505 Aug 06 01:37:39.974403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 301/617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:39 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:40.512654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:40.513290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:40.520436 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:40.520922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:40.521388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:40.522083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:40.522544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:40.522984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:40.649644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:40.657396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:40.658906 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:40.660116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c27041fc-6ab8-43f4-a893-f404286e49c3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.151336 Aug 06 01:37:40.660667 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 317/618] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:40 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:40.994974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:40.995577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:41.001823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:41.002308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:41.002734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:41.004290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:41.004939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:41.005563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:41.141956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:41.150372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c976db16-c2b0-4405-af30-27a7de6f47a0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.159433 Aug 06 01:37:41.150948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 302/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:40 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:41.682426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:41.682970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:41.689545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:41.690026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:41.690940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:41.691637 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:41.692093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:41.692519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:41.827510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:41.837112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:41.838668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:41.839864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ba56ff70-7163-4021-bde0-d5fd1d097518 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.161373 Aug 06 01:37:41.840420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 318/620] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:41 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:42.171715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:42.172357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:42.178822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:42.179314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:42.179747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:42.180437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:42.180894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:42.181344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:42.185326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:42.312916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:42.321520 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2782af1d-a3d0-4583-98bb-30d682666936 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.153669 Aug 06 01:37:42.322099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 303/621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:42 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:42.871004 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:42.871613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:42.877697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:42.878945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:42.879572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:42.880270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:42.880726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:42.881174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:43.008628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:43.016486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:43.018032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:43.019186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-daf95395-4729-426f-8331-5104da61720f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.152350 Aug 06 01:37:43.019751 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 319/622] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:42 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:43.343422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:43.344036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:43.346419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=66 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:43.352686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:43.353209 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:43.353649 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:43.354340 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:43.354800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:43.355233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:43.483300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:43.492256 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5e22a10d-36ac-4698-901c-7b6e83cfa4d9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.152407 Aug 06 01:37:43.492808 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 304/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:43 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:44.041344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:44.041885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:44.048211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:44.048699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:44.049161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:44.049960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:44.050418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:44.050846 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:44.335521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:44.343255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:44.344760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:44.345942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-018c8b3e-2197-4058-b170-be020126947c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.308576 Aug 06 01:37:44.346501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 320/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:44 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:44.513304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:44.513911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:44.520514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:44.520999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:44.521473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:44.522160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:44.522620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:44.523049 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:44.700878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:44.708803 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ef65c827-9726-4d42-a54b-8b2cc2342be3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.199430 Aug 06 01:37:44.709418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 305/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:44 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:45.368032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:45.368647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:45.375029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:45.375512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:45.375953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:45.376643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:45.377128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:45.377559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:45.508361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:45.516420 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:45.517963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:45.519858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cfad13e0-ea0a-4653-ada8-9a3dbcab87eb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.156066 Aug 06 01:37:45.520422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 321/626] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:45 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:45.730720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:45.731328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:45.737720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:45.738202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:45.738638 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:45.739323 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:45.739775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:45.740200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:45.866073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:45.874348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1a688f07-e940-45b6-9e7f-99024fc3995b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.147492 Aug 06 01:37:45.874919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 306/627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:45 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:46.542755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:46.543368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:46.550497 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:46.550991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:46.551431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:46.552116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:46.552570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:46.552996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:46.678284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:46.686141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:46.687642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:46.688785 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-173a8da1-a6fc-4958-9d97-59b45e758c69 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.149966 Aug 06 01:37:46.689371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 322/628] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:46 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:46.900448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:46.901075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:46.907025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:46.907505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:46.907939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:46.908618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:46.909690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:46.910119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:47.042567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:47.050626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f24a972c-1c01-4ff1-992c-74090ba36ddc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.154189 Aug 06 01:37:47.051202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 307/629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:46 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:47.710435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:47.711072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:47.717454 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:47.717962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:47.718399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:47.719091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:47.719545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:47.719974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:47.848509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:47.856351 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:47.857880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:47.859022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d6f4b5c9-a784-4d87-8018-c401c59a40f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.152681 Aug 06 01:37:47.859580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 323/630] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:47 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:48.072458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:48.073189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:48.080503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:48.081750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:48.082188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:48.082868 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:48.083666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:48.084095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:48.228968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:48.237018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dbd9cafa-d7f0-46d7-9f84-720b3dc994f2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1721 microversion: 2.1 time: 0.168526 Aug 06 01:37:48.237731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 308/631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:48 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:48.884040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:48.884572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:48.891182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:48.891656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:48.892090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:48.892769 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:48.893284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:48.893887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.020441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:49.028212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:49.029750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:49.030893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8240c07f-ed64-4856-bd9b-cc56ced4a90e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.150823 Aug 06 01:37:49.031445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 324/632] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:48 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:49.258534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:49.259146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:49.265548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:49.266072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:49.266691 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.267399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:49.267841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:49.268311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.404069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:49.412719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-047401fd-d01d-43f6-abe8-2b241187ef96 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1698 microversion: 2.1 time: 0.158010 Aug 06 01:37:49.413325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 309/633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:49 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:49.433960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:49.440037 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:49.441121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:49.441564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.504449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Going to try to start instance {{(pid=124313) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 01:37:49.547589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7d99c657-9910-4e63-bef2-5e93ea1bc0c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.117576 Aug 06 01:37:49.548385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 325/634] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:37:49 2022] POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:37:49.558341 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:49.559321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:49.565953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:49.566451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:49.567031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.567749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:49.568199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:49.568841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:49.752233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:49.761929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-61863d8c-255c-4ec8-ae33-19b490ccdbad tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.208585 Aug 06 01:37:49.762516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 310/635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:49 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:50.055629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:50.056349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:50.063755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:50.064259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:50.064707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:50.065485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:50.065949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:50.066382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:50.202870 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:50.211021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:50.212592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:50.213782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c4a3d37d-edf2-4bf0-9b46-719454b1340f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.162747 Aug 06 01:37:50.214330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 326/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:50 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:50.783189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:50.783795 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:50.790345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:50.790824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:50.791251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:50.791927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:50.792375 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:50.792790 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:50.919258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:50.927569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ac51646e-d7bb-4f1d-ad32-8d74aeb38c34 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.148184 Aug 06 01:37:50.928139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 311/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:50 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:51.236718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:51.238218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:51.244804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:51.245328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:51.245762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:51.246443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:51.246894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:51.247321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:51.380579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:51.389174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:51.390703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:51.391863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9be39ac6-9f90-436b-b523-3e92e8bc5f52 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.159011 Aug 06 01:37:51.392431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 327/638] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:51 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:51.949016 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:51.949642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:51.956765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:51.957295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:51.957729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:51.958416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:51.958871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:51.959293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:52.087554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:52.095373 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7e95e325-fa71-4d7a-997a-2240445040d4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.150315 Aug 06 01:37:52.095926 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 312/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:51 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:52.414891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:52.415536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:52.421976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:52.422464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:52.422907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:52.423597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:52.424075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:52.424604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:52.553782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:52.561754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:52.563276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:52.564444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-409683a7-61df-4b23-8917-afa68e82c55d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.153436 Aug 06 01:37:52.565515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 328/640] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:52 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:53.118521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:53.119160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:53.125938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:53.126410 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:53.127032 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:53.127909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:53.128369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:53.128794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:53.563329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:53.571250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3804e13d-4ca1-4fdf-8a6d-25aaaf2cb25f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.457332 Aug 06 01:37:53.571806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 313/641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:53 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:53.587597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:53.588216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:53.594652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:53.595140 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:53.595571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:53.596903 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:53.597458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:53.597888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:53.757924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:53.765957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:53.767510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:53.769351 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4393ee23-8888-4589-8e5f-d8d25d0467bd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.185562 Aug 06 01:37:53.769916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 329/642] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:53 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:54.593193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:54.593738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:54.600256 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:54.601089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:54.601719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:54.602514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:54.603074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:54.603597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:54.734784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:54.743111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-746632d5-99d3-482f-8da5-eed411c80510 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.154010 Aug 06 01:37:54.743686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 314/643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:54 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:54.791809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:54.792450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:54.798852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:54.799341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:54.799833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:54.800673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:54.801156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:54.801584 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:54.805524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:54.929668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:54.937434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:54.938942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:54.940719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c96f84fc-8ea1-4bbd-9cb9-0e642e97b730 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.152178 Aug 06 01:37:54.941416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 330/644] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:54 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:55.765212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:55.765842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:55.772879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:55.773384 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:55.773814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:55.774496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:55.774945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:55.775362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:55.906466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:55.916647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6f12ee5f-4811-46c9-827d-fe9719d8abbf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1707 microversion: 2.1 time: 0.155110 Aug 06 01:37:55.917568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 315/645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:55 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:55.963480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:55.964091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:55.970738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:55.971297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:55.972302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:55.973034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:55.973537 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:55.973969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:56.101832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:56.109617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:56.111125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:56.112364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-05415f19-1407-4ff2-a017-75bde978fb21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.152943 Aug 06 01:37:56.112928 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 331/646] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:55 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:56.938214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:56.938834 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:56.945339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:56.945828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:56.946268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:56.946968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:56.947804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:56.947958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:57.081989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:57.090153 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a9a85e69-04d9-4bbb-9c02-85d8c33a06ae tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1711 microversion: 2.1 time: 0.155929 Aug 06 01:37:57.090726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 316/647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:37:56 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:37:57.135662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:57.136272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:57.142435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:57.142908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:57.143874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:57.144569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:57.145029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:57.145484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:57.272065 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:57.279940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:57.281498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:57.282655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f3b3784-675a-4236-8943-bc74c1f7b6b0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.150935 Aug 06 01:37:57.283219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 332/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:57 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:57.649247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:57.649857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:57.655700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:57.656179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:57.656615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:57.657334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:57.657796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:57.658227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:57.736023 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lazy-loading 'services' on Instance uuid b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:37:57.807707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e3a5925c-5d73-4405-ad67-fcfdae98b094 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7/os-volume_attachments/4b72205d-5707-455f-bb9b-1c1a20c5918a" status: 202 len: 0 microversion: 2.1 time: 0.162347 Aug 06 01:37:57.808308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 317/649] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:37:57 2022] DELETE /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7/os-volume_attachments/4b72205d-5707-455f-bb9b-1c1a20c5918a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:37:58.120377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:37:58.120575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:37:58.306006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:58.306619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:58.312934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:58.313449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:58.313884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:58.314569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:58.315576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:58.316049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:58.442892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:58.450868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:58.452374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:58.453701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-638c319b-aefa-45d5-8d6c-a2597f08343c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.151487 Aug 06 01:37:58.454121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 333/650] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:58 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:58.565504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "name": "network-vif-plugged", "status": "completed", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:37:58.575521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:58.576002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:58.576437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:58.588386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] Creating event network-vif-plugged:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:37:58.593140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-b0614f7a-dab9-408b-981c-b3e21d6089af req-179372be-8229-4093-a9d8-6d6b8ca55e52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Aug 06 01:37:58.593906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 318/651] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:37:59.477365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:59.477975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:37:59.484508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:59.484993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:59.485457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:59.486149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:37:59.486600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:37:59.488309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:37:59.653703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:59.662251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:59.663782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:37:59.664953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-075222e6-0b96-406e-b90e-d33611ad00c9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.191673 Aug 06 01:37:59.665576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 334/652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:37:59 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:37:59.993392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:37:59.993989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:00.002161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.003274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.003714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.004397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.004846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.005307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.031906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:38:00.034885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:00.106825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bb8486d6-7d53-4940-bca3-6691ff4ad115 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 204 len: 0 microversion: 2.1 time: 0.118184 Aug 06 01:38:00.107315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 319/653] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:37:59 2022] DELETE /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:38:00.116085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:00.116754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:00.122979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.123458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.123894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.124580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.125035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.125483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.251865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:00.259870 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c13ebfbc-b2f9-4b89-9ed9-f85298f75ce4 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1513 microversion: 2.1 time: 0.148196 Aug 06 01:38:00.260438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 335/654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:00 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:00.687805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:00.688499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:00.694631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.695122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.695562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.696243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:00.696725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:00.697178 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:00.827912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:00.835816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:00.837342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:00.838483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-485392fd-9a6e-4a17-afbd-52f7ab57b228 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.154948 Aug 06 01:38:00.839050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 320/655] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:00 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:01.280773 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:01.281430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:01.288092 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:01.288572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:01.289002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:01.289711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:01.290193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:01.290639 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:01.420941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:01.428629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f5e19ad-4d1d-4fb7-8961-27099708dd14 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1513 microversion: 2.1 time: 0.151732 Aug 06 01:38:01.429226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 336/656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:01 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:01.862305 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:01.862968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:01.869547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:01.870053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:01.870499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:01.871164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:01.871615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:01.872037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:02.005146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:02.013064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:02.014580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:02.015731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a7691104-da1f-4871-a5df-a9df65a24cdc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1742 microversion: 2.20 time: 0.157812 Aug 06 01:38:02.016310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 321/657] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:01 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:02.449841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:02.450559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:02.457368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:02.457849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:02.458272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:02.458951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:02.459397 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:02.459820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:02.593290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:02.601966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-739afcda-9628-41ef-9e25-300003ccb31f tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1513 microversion: 2.1 time: 0.155923 Aug 06 01:38:02.602544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 337/658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:02 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:03.062074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7", "name": "network-vif-deleted", "tag": "ca3ff6d9-7875-4d0b-9327-2177398ac8fa"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:03.074381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.075091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.075701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.096282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] Creating event network-vif-deleted:ca3ff6d9-7875-4d0b-9327-2177398ac8fa for instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 on hv-cinder-85200 Aug 06 01:38:03.106662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-10e0c6d8-4225-49e3-9242-410e5fdb2c8d req-285bb20e-d22b-48f4-bfba-ca572ef3da20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049544 Aug 06 01:38:03.108100 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 338/659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:38:03.248615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:03.249446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:03.256872 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.257394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.257837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.258541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.258998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.259431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.410977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:03.419881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:03.421459 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:03.422610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e80d6ad4-429e-435d-8f38-1938b81dd416 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.388083 Aug 06 01:38:03.423166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 322/660] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:03 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:03.624908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:03.625638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:03.633097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.633591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.634193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.635134 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.635586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.636229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.674469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:03.675020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:03.675565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:03.676120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lazy-loading 'fault' on Instance uuid b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:38:03.724594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c938a575a2704078a82fe6df941884dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50641dc16fa4187b5f0d4f936d34d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:03.732359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a80fe256-bb63-43f7-91a2-8fc02f374d3b tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 200 len: 1309 microversion: 2.1 time: 0.112294 Aug 06 01:38:03.732793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 339/661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:03 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:04.454700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:04.460317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:04.474811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:04.475352 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:04.475870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:04.480816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:04.483247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:04.484424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:04.692556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:04.700943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:04.702883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:04.704081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b68acee4-4353-4c8d-a260-bffed8c8fbb4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.261353 Aug 06 01:38:04.704656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 323/662] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:04 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:04.755940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:04.757210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] [instance: b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:04.766431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:04.767176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:04.767800 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:04.768707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:04.769227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:04.769874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:04.784916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] HTTP exception thrown: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Request method failure captured: Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 HTTP/1.1 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cUBEyVI-W7litMxPk784ccrLa7KBnyYE_RhCQg00PzH5bOVW6Cyl4OeKpFJQBGOrBtdHY_tKt5QkUgsnfjOxwkMM77iSiKIBqt156G3F9Wt6Mky0DJRbk2G2a7ALtetPzAk7QAqNwzwy54xvxgH-FAvxnTtYCscyjwzVxP_jV0M7MY Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: e50641dc16fa4187b5f0d4f936d34d53 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:38:04.788157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e50641dc16fa4187b5f0d4f936d34d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e50641dc16fa4187b5f0d4f936d34d53"}]}] Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: e50641dc16fa4187b5f0d4f936d34d53 Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2123842345 Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-VolumesSnapshotTestJSON-2123842345-project Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: c938a575a2704078a82fe6df941884dc Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-VolumesSnapshotTestJSON-2123842345-project Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. Aug 06 01:38:04.791395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7'} Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:38:04.792153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. Aug 06 01:38:04.793393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:38:04.794535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] Returning 404 to user: Instance b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:38:04.794535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c7e41bd7-c773-47ca-b728-222be0095f46 tempest-VolumesSnapshotTestJSON-2123842345 tempest-VolumesSnapshotTestJSON-2123842345-project] 10.222.0.26 "GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7" status: 404 len: 111 microversion: 2.1 time: 0.038811 Aug 06 01:38:04.794535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 340/663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:04 2022] GET /compute/v2.1/servers/b8c2d12d-af02-44f2-9fe1-0ad4c8f39dd7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:38:05.728540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:05.729838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:05.736775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:05.737377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:05.738053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:05.739031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:05.739482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:05.739902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:05.877329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:05.887007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:05.888531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:05.889754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b1ccf30f-0845-4bf7-8c1a-1eacc0498dcb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.165395 Aug 06 01:38:05.890660 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 324/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:05 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:38:06.920863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:06.921429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:06.928984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:06.929495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:06.929929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:06.930614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:06.931067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:06.931486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:07.084198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:07.096961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:07.096961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:07.096961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8dd2504d-3a83-4037-8b88-b2fd04f5aed5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.178352 Aug 06 01:38:07.097394 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 341/665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:06 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:08.119554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:08.120196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:08.127418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:08.127912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:08.128351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:08.129330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:08.130122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:08.130910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:08.279422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:08.288140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:08.294043 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:08.295391 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1d2d0d7f-7708-4127-8a12-10b9ee89cb3a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.180141 Aug 06 01:38:08.296218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 325/666] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:08 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:09.320469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:09.321111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:09.328748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:09.329290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:09.329797 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:09.330626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:09.331089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:09.331560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:09.517811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:09.526815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:09.528404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:09.529704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e5bbc31-c4bf-4a01-9a3d-b0fc44cbc0bb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.214472 Aug 06 01:38:09.533386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 342/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:09 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:10.554149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:10.554940 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:10.561330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:10.561899 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:10.562426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:10.563222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:10.564318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:10.564318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:10.715912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:10.725775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:10.727414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:10.728590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a2ba02bc-9e5e-4fd9-bc59-f63b66f6d08e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.179308 Aug 06 01:38:10.741073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 326/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:10 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:11.754030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:11.754890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:11.769304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=56 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:11.776623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:11.777027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:11.777484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:11.778229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:11.778713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:11.779137 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:11.946831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:11.964201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:11.965800 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:11.967250 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8e4c0b35-f840-41e1-b0da-e9bcfbff26b6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.218177 Aug 06 01:38:11.967840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 343/669] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:11 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:12.991480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:12.992093 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:12.998822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:12.999310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:12.999746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:13.000430 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:13.000881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:13.001332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:13.133550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:13.141537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:13.143045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:13.144224 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6d234abc-e442-4a49-9acb-65b89e9e4653 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.157210 Aug 06 01:38:13.144891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 327/670] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:12 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:14.167880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:14.168524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:14.174390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:14.174885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:14.175385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:14.176080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:14.176732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:14.177188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:14.305604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:14.313350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:14.314843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:14.317081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7e50a441-5758-4dcb-9565-eaac1fe7b333 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1737 microversion: 2.20 time: 0.153069 Aug 06 01:38:14.317709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 344/671] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:14 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:15.340958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:15.341590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:15.344067 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:15.350160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:15.350651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:15.351088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:15.351775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:15.352231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:15.352681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:15.481613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:15.489465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:15.490968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:15.492117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-04ccf53b-12b9-46b9-8960-4a7730b82df0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1719 microversion: 2.20 time: 0.155043 Aug 06 01:38:15.492943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 328/672] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:15 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:16.515815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:16.516430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:16.523144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:16.523581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:16.524021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:16.524715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:16.525215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:16.525646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:16.655081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:16.663655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:16.665198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:16.666362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3d992822-825b-4b34-a121-d5f5d0aa1c6b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1719 microversion: 2.20 time: 0.154505 Aug 06 01:38:16.666923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 345/673] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:16 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:17.688998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:17.689629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:17.696433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:17.696914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:17.697371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:17.698056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:17.698509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:17.698931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:17.825511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:17.833374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:17.834803 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:17.835935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d772c5c0-f957-4b90-8c68-ba27fd4c1d6f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1719 microversion: 2.20 time: 0.150795 Aug 06 01:38:17.836497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 329/674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:17 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:18.858993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:18.859607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:18.866783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:18.867528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:18.867957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:18.868634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:18.869103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:18.869530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:19.000956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:19.009801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:19.011312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:19.012473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ba8fc2ac-6e65-419f-ab4f-871dea4640e1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1719 microversion: 2.20 time: 0.157366 Aug 06 01:38:19.013038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 346/675] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:18 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:20.035147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:20.035759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:20.042306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:20.042920 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:20.043404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:20.044097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:20.044645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:20.045260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:20.174149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:20.182052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:20.183562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:20.184718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9cc2d685-131f-4df2-b469-b1c83246f18d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1719 microversion: 2.20 time: 0.153615 Aug 06 01:38:20.185319 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 330/676] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:20 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:21.209215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:21.209854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:21.216495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.216980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.217447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.218137 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.218599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.219025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.348640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:21.350855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:21.357649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:21.359143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:21.360292 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5116f067-d97f-48fd-b266-9c47a559dc70 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1722 microversion: 2.20 time: 0.156062 Aug 06 01:38:21.360851 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 347/677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:21 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:21.382678 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3f4145-bf48-47ae-b579-200dc1f5359d"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:21.385187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:21.391574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.392057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.392487 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.393205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.393656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.394796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.676894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2e44ec04-a02f-4e20-a395-710ceb1d8a5c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298463 Aug 06 01:38:21.677542 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 331/678] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Aug 6 01:38:21 2022] POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:38:21.797343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:21.797933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:21.803876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.804359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.804791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.805504 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.805963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.806384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.895956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124313) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 01:38:21.963612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6061c0a2-fbbb-40f3-bed5-fe236f6fce5f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/action" status: 202 len: 0 microversion: 2.20 time: 0.170118 Aug 06 01:38:21.964296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 348/679] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Aug 6 01:38:21 2022] POST /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:38:21.973111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:21.973814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:21.980392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.980881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.981359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.982049 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:21.982499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:21.983113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:21.987060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:22.145955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:22.154376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:22.155972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:22.157176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-74ab8dcf-1fb7-412e-bdda-3bf150e0460f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1748 microversion: 2.20 time: 0.188624 Aug 06 01:38:22.157943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 332/680] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:21 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1748 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:22.924061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:22.936754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:22.937299 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:22.937910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:22.949814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.compute.server_external_events [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] Unable to find a host for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2. Dropping event network-vif-unplugged {{(pid=124313) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 01:38:22.950688 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-9801e760-bfd6-45f1-b2a7-ae71b9ac5bf8 req-173ccf2a-6844-48ce-b438-2145cb9d7f86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031356 Aug 06 01:38:22.951277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 349/681] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 06 01:38:23.180446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:23.181133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:23.187520 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:23.187996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:23.188425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:23.189135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:23.189588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:23.190010 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:23.319953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:23.328444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:23.329977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:23.331140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a3b37058-e0b5-4168-b8bf-eef3f1952125 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1750 microversion: 2.20 time: 0.154571 Aug 06 01:38:23.332300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 333/682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:23 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:24.354581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:24.355192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:24.361654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:24.362136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:24.362599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:24.363321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:24.363777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:24.364203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:24.499264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:24.508242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:24.509793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:24.510955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b6b0c62a-2c0c-471e-afa2-97dad9fbbf0b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.160354 Aug 06 01:38:24.511523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 350/683] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:24 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:25.536292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:25.536674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:25.543219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:25.543704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:25.544141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:25.544842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:25.545326 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:25.545754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:25.722618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:25.736648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:25.739680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:25.741330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bf83cad1-05dd-4e1c-9a86-ceed1599dad1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.209805 Aug 06 01:38:25.742789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 334/684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:25 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:26.768121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:26.769360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:26.775530 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:26.776010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:26.776444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:26.777274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:26.777735 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:26.778157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:26.905556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:26.914996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:26.916510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:26.917731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cad3ba3f-20a7-44dc-96dd-76314ee87133 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.153648 Aug 06 01:38:26.933113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 351/685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:26 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:27.949879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:27.950466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:27.957429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:27.957904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:27.958333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:27.959013 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:27.959460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:27.959877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:28.124841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:28.151581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:28.154607 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:28.160164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8aa004cb-5120-4d4a-999d-65be3e0656e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.213450 Aug 06 01:38:28.163151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 335/686] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:27 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:29.189540 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:29.190203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:29.196904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:29.197492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:29.197937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:29.198624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:29.199079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:29.199505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:29.362380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:29.371572 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:29.373149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:29.374316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4ddaa9e6-41c2-4545-861c-fbb93ca34d58 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.188716 Aug 06 01:38:29.374874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 352/687] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:29 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:30.397413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:30.397991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:30.404394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:30.404874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:30.405332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:30.406019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:30.406467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:30.406886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:30.540929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:30.549858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:30.551998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:30.553189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ae33ea70-cd12-4089-a1f3-6aa2512e18f0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.159889 Aug 06 01:38:30.553789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 336/688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:30 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:31.575885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:31.576505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:31.583295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:31.583778 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:31.584238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:31.584925 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:31.585414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:31.585838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:31.737467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:31.746871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:31.748374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:31.749562 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-838ff292-a2a1-48fa-820a-47013c47fcca tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.177673 Aug 06 01:38:31.750114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 353/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:31 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:32.774028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:32.775456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:32.782498 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:32.783461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:32.784100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:32.785006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:32.785686 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:32.786308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:32.951895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:32.961268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:32.962777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:32.967915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b690788b-c0df-4993-823e-7ea94f00cca7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.198476 Aug 06 01:38:32.968486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 337/690] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:32 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:33.993709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:33.995097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:34.001209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:34.001709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:34.002151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:34.002897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:34.003391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:34.003825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:34.260268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:34.275833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:34.277565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:34.278859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a98a0f9e-e3c7-4218-a019-e06c9847d20f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.289660 Aug 06 01:38:34.279467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 354/691] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:33 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:35.304928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:35.305883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:35.313804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:35.314281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:35.314720 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:35.315450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:35.315899 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:35.316315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:35.654160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:35.672967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:35.675475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:35.679397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c06ff317-fa05-4d98-978d-b0348d7e5efe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.379741 Aug 06 01:38:35.696676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 338/692] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:35 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:36.704982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:36.708593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:36.718643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:36.720466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:36.721010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:36.721885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:36.722549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:36.723208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:36.965246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:36.976752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:36.986807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:36.988358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b632f0ef-771d-480e-9c61-7d16297d44d7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.287253 Aug 06 01:38:36.988907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 355/693] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:36 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:38.014467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:38.015809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:38.024171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:38.025012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:38.025759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:38.026848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:38.027528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:38.028197 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:38.202292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:38.211900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:38.213481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:38.214860 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9d62931e-f6b3-437e-bf4c-35a18413e9f7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.206989 Aug 06 01:38:38.215429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 339/694] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:38 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:38.574710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:38:38.575104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:38:39.239612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:39.240313 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:39.247513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:39.248147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:39.249009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:39.249858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:39.250336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:39.251175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:39.479656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:39.490154 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:39.491742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:39.493410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-dc9f2fcd-a0c5-4e3b-971c-dae877398196 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.257894 Aug 06 01:38:39.507229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 356/695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:39 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:40.524903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:40.525655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:40.534128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:40.534723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:40.535986 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:40.536710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:40.537203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:40.537635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:40.799084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:40.811162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:40.813063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:40.814862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-42d45d65-b00e-4f4d-9892-e7cab23ec3f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.299150 Aug 06 01:38:40.833812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 340/696] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:40 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:41.839609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:41.840229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:41.846056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:41.849215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:41.850177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:41.850838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:41.851791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:41.852489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:41.853166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:42.053784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:42.065507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:42.068438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:42.071490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-46839a46-c435-4b9d-a524-d5c6882aa06d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.236534 Aug 06 01:38:42.072419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 357/697] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:41 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:43.099343 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:43.100842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:43.107827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:43.108628 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:43.109368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:43.110615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:43.111284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:43.111926 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:43.273369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:43.282196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:43.284007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:43.285303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-98d829d5-4772-4be9-9efb-1e6bc4355c19 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.190814 Aug 06 01:38:43.285973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 341/698] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:43 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:44.308595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:44.309717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:44.315774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:44.316272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:44.317398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:44.318103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:44.318564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:44.318994 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:44.513492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:44.522250 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:44.524487 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:44.525700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4448ba24-9f46-4157-8f55-950b6f3d378f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.221343 Aug 06 01:38:44.526254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 358/699] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:44 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:45.547888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:45.549290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:45.553313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=28 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:45.565586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:45.566895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:45.567506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:45.568221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:45.568678 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:45.569130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:45.761665 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:45.771840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:45.773573 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:45.774904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-17944c7d-231c-4168-b614-bf08ad16af97 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.231008 Aug 06 01:38:45.789072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 342/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:45 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:46.802681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:46.803447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:46.810315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:46.810915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:46.811451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:46.812435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:46.812998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:46.813700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:46.966093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:46.976319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:46.978294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:46.979784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5824ff46-5b42-4f22-976a-a81951127dc6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.181855 Aug 06 01:38:46.980904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 359/701] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:46 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:48.004913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:48.006217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:48.012556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:48.013309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:48.013909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:48.015164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:48.015797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:48.016403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:48.189061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:48.198709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:48.200295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:48.201579 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6ec4ae02-d1cb-4f8d-aa02-4f0156d8797f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.200938 Aug 06 01:38:48.202676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 343/702] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:47 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:49.233944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:49.235173 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:49.242950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:49.243753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:49.244393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:49.245342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:49.245994 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:49.246611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:49.523598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:49.536161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:49.538759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:49.540373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-34f0d72b-f610-4074-a04d-deef9f83a8ab tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.310854 Aug 06 01:38:49.541329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 360/703] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:49 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:49.735765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d41463e-cc20-42d7-994c-beb4dd095294"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:49.738463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:49.744774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:49.745504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:49.746195 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:49.746947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:49.747610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:49.748242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:50.075423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-40903527-9387-457e-8855-17a8aab908a9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.590678 Aug 06 01:38:50.076040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 344/704] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:38:49 2022] POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:38:50.566720 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:50.567402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:50.576136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:50.576853 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:50.577328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:50.578077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:50.578877 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:50.579296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:50.732866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:50.744174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:50.746239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:50.748459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4f434d21-da0c-44e5-9d24-4d777773e172 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.185761 Aug 06 01:38:50.749320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 361/705] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:50 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:51.773414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:51.774792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:51.781543 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:51.782132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:51.782682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:51.783625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:51.784301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:51.784950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:51.940514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:51.950533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:51.952363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:51.953808 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d2210f5c-ba7d-4286-aa9a-04151cf836da tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.185741 Aug 06 01:38:51.969434 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 345/706] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:51 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:52.809293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-026faa7a-c95c-4e12-9410-e75fbc1f91c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'create', calling method: .version_select at 0x7fbff4118700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1077788567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO15PXTF/Vfw7CWmhAqZdbjiBHfbqYm3r7NlviyF36N3kvlOk2qWyTMnEmjaHeXCIvlJ6+ZZiMH/k1WZxifznq+VWiDNVlSx+rPOfi0Q4a/HT5SPQ0J0ViA/CKo3K/ZNpw=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:52.824868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-026faa7a-c95c-4e12-9410-e75fbc1f91c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Getting quotas for project 4db9537bd65748f6b43061f3530f6891. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:38:52.828608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-026faa7a-c95c-4e12-9410-e75fbc1f91c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Getting quotas for user 5cb73f6047dd42aaba23072f51972e9f and project 4db9537bd65748f6b43061f3530f6891. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:38:52.854501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-026faa7a-c95c-4e12-9410-e75fbc1f91c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049096 Aug 06 01:38:52.856265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 362/707] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:38:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:38:52.906097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2071407075", "imageRef": "322bc643-064b-4a6a-b4d7-846fd345681a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1077788567", "networks": [{"uuid": "c1265642-2af9-40d1-9f99-4e6abd3780d3"}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:52.959751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] validate_networks() for [('c1265642-2af9-40d1-9f99-4e6abd3780d3', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:38:52.978622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:52.979396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:52.986222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:52.986712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:52.987146 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:52.987838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:52.988490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:52.989083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:52.993837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:53.172098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:53.181220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:53.182707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:53.183872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8647101b-2511-4945-a9a7-d29daff8decb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.209347 Aug 06 01:38:53.184756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 363/708] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:52 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:53.249245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "name": "network-vif-plugged", "status": "completed", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:53.259112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:53.259585 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:53.260010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:53.271191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] Creating event network-vif-plugged:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:38:53.276267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-3fe7bdb7-b5f0-4c95-8925-b35365f90e53 req-a153e000-2cda-47b1-9d1c-74f3e4485415 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090344 Aug 06 01:38:53.276918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 364/709] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:38:53.519731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:38:53.520247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:38:53.520732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:38:53.521173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:38:53.521622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:38:53.530143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:53.530632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:53.531070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:53.531794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:53.532250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:53.532680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:53.538690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:53.552961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Getting quotas for project 4db9537bd65748f6b43061f3530f6891. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:38:53.556828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Getting quotas for user 5cb73f6047dd42aaba23072f51972e9f and project 4db9537bd65748f6b43061f3530f6891. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:38:53.568285 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:38:53.570518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='322bc643-064b-4a6a-b4d7-846fd345681a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:38:53.615515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e7dbc0c9-28ea-44c2-846e-0c533dd64857 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713287 Aug 06 01:38:53.616336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 346/710] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:38:53.627509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-58d21dd9-eac0-4041-a6ce-0d8ec6307a2c tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:53.628196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-58d21dd9-eac0-4041-a6ce-0d8ec6307a2c tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:53.686135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-58d21dd9-eac0-4041-a6ce-0d8ec6307a2c tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:53.693041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-58d21dd9-eac0-4041-a6ce-0d8ec6307a2c tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1259 microversion: 2.1 time: 0.069700 Aug 06 01:38:53.693659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 365/711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:53 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:54.208402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:54.209014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:54.215943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:54.216433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:54.216869 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:54.217586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:54.218041 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:54.218466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:54.348625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:54.357070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:54.358620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:54.359779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6da07ce1-79c5-49d8-b859-40849ba1d2d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.155666 Aug 06 01:38:54.360340 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 347/712] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:54 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:54.714035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:54.714646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:54.721727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:54.722206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:54.722754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:54.723610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:54.724087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:54.724538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:54.783827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:54.791377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-420e6a9c-0c31-4e90-bd2a-1d6ee99821f4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1255 microversion: 2.1 time: 0.081136 Aug 06 01:38:54.791941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 366/713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:54 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:55.382953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:55.383552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:55.389909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:55.390388 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:55.390821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:55.391505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:55.391971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:55.392370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:55.521546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:55.529935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:55.531443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:55.532606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fccbb4b3-b29b-4d2c-82d1-34fff81214cc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1806 microversion: 2.20 time: 0.153601 Aug 06 01:38:55.533200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 348/714] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:55 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:55.811907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:55.812596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:55.819304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:55.819795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:55.820229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:55.820960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:55.821470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:55.821896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:55.894178 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:55.901856 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e883d653-1c2c-4803-b084-f4badf784000 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1319 microversion: 2.1 time: 0.094037 Aug 06 01:38:55.902440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 367/715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:55 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:56.555766 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:56.556578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:56.563602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:56.564099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:56.564528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:56.565267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:56.565721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:56.566143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:56.695403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:56.703762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:56.705307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:56.706463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ea4ccd44-05ce-493a-b47f-be099ddf1a4c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1793 microversion: 2.20 time: 0.154680 Aug 06 01:38:56.707028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 349/716] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:38:56 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1793 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:38:56.924341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:56.924848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:56.931095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:56.931579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:56.932035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:56.932705 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:56.933191 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:56.933626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:56.995381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:57.002995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-61ca404b-faf9-4de8-af31-0467ea7eabd1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1329 microversion: 2.1 time: 0.082638 Aug 06 01:38:57.003582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 368/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:56 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:57.686097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:57.689137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:57.697097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:57.697807 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:57.698315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:57.699087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:57.699613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:57.700122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:57.728195 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'flavor' on Instance uuid f5405de5-e911-4d71-9d79-bfd872cd2044 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:38:57.912574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-059db76c-2c8d-4f1e-b4ad-79b8118cf8ea tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/action" status: 200 len: 32 microversion: 2.1 time: 0.231756 Aug 06 01:38:57.919581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 350/718] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:38:57 2022] POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:38:57.923601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:57.924364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:57.932804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:57.933348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:57.935054 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:57.936537 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:57.937824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:57.938825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:58.027174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:58.028120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:58.038872 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:58.039786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:58.040414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:58.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:58.041937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:58.042785 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:58.387055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:58.408974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9245f5d6-3e93-413d-890a-88a1bd6a61f5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.489439 Aug 06 01:38:58.429118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:58.429118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-07ac3cdd-1fbc-4113-adc1-436d56c7c88e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.401522 Aug 06 01:38:58.431951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 369/719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:57 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:38:58.438242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 351/720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:58 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:38:58.909300 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:38:58.920601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:58.921106 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:58.921543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:58.934869 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] Creating event network-changed:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:38:58.940017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-996ad3ff-2f3f-4d3f-a96f-ebaaa1bb8cc2 req-d6f3fd9c-9d19-4fe4-9ff3-4c401371c51c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107245 Aug 06 01:38:58.940620 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 370/721] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:38:59.433293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:59.433999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:59.440549 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:59.441161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:59.442384 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:59.443214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:59.443760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:59.444250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:59.448103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:38:59.448893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:38:59.455771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:59.456262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:59.456699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:59.457430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:38:59.457889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:38:59.458315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:38:59.669018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:59.676906 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:38:59.684217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-323c2567-1d3c-4f51-bcb1-ec0897ca8565 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.254766 Aug 06 01:38:59.685230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 352/722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:59 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:38:59.688216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7ebed997-e4f2-4fa9-b6fb-949d91484cdc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.245338 Aug 06 01:38:59.688786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 371/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:38:59 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:00.706277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:00.706889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:00.708648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:00.709303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:00.714553 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:00.715058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:00.715492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:00.715878 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:00.716193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:00.716655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:00.716987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:00.717214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:00.717795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:00.718648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:00.719264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:00.719859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:00.922360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:00.931154 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:00.931908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-85f42598-bf81-4c61-8b60-cf822424d01b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.229067 Aug 06 01:39:00.934284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 353/724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:00 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:00.940693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-065ca4f9-ef77-4414-b520-2943e68566c8 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.235682 Aug 06 01:39:00.942552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 372/725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:00 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:01.952866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:01.953561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:01.961351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:01.961944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:01.962083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:01.962586 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:01.962786 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:01.963313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:01.963805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:01.964309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:01.969656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:01.969865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:01.970718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:01.970854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:01.971312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:01.971739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:02.183551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:02.187930 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:02.191228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9293e19b-330a-4edb-848d-aad578521527 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.233695 Aug 06 01:39:02.198622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-99dd1c77-a14a-4f29-b09a-885293d76e97 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.249470 Aug 06 01:39:02.206995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 373/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:01 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:02.207849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 354/727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:01 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:03.214141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:03.216196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:03.224295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:03.225559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:03.225858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:03.226486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:03.226996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:03.227774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:03.228417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:03.228933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:03.234243 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:03.234851 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:03.235182 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:03.235893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:03.236358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:03.236783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:03.441995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:03.450414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bb119609-6841-424f-8232-6b129ba20c43 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.230978 Aug 06 01:39:03.451266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 355/728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:03 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:03.459023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:03.468834 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-290d4862-dd44-40ad-b140-243c71eb6936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.258630 Aug 06 01:39:03.469375 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 374/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:03 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:04.471710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:04.472316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:04.474501 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:04.475331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:04.482663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:04.483160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:04.483602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:04.484300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:04.484755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:04.485203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:04.491126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:04.492501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:04.499139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:04.502388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:04.503222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:04.505926 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:04.507033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:04.507968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:04.509132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:04.735833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:04.747997 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:04.750775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f382c18a-fbb7-42b0-aa16-ecacbeddbc21 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.282862 Aug 06 01:39:04.751734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 356/730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:04 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:04.756638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-75f2a1c1-9d42-48a9-b32b-11a886c38f9e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.269967 Aug 06 01:39:04.757227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 375/731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:04 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:05.772307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:05.773281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:05.778176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:05.778795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:05.780294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:05.780873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:05.781426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:05.782215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:05.782882 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:05.783332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:05.787909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:05.788733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:05.789264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:05.790125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:05.790812 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:05.791417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:05.998843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:06.000095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:06.007005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fa9cec29-8c62-44d1-8f34-5d24eec8a46b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.232632 Aug 06 01:39:06.007970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 376/732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:05 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:06.010161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5ae660c1-659b-4dc2-95ea-12775e7d83e3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.241852 Aug 06 01:39:06.011226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 357/733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:05 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:07.029274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:07.029965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:07.030985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:07.031592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:07.037023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:07.037578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:07.038011 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:07.038682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:07.038805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:07.039133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:07.039238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:07.039549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:07.039650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:07.040251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:07.040709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:07.041157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:07.234089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:07.237235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:07.241758 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-136cb957-da33-4ff7-9ba9-9d2e7537b80b tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.216422 Aug 06 01:39:07.242330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 377/734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:07 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:07.245913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-21eb3830-862f-41ee-bec3-180b5be0c25b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.218668 Aug 06 01:39:07.246507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 358/735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:07 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:08.265228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:08.265842 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:08.267099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:08.267749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:08.272971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:08.273489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:08.273930 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:08.274641 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:08.274747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:08.275081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:08.275248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:08.275508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:08.275692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:08.276380 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:08.276844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:08.277295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:08.463649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:08.471167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-82fab421-8d7d-48e5-9dc8-2702b5bfbd84 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.209824 Aug 06 01:39:08.472680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 378/736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:08 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:08.474379 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:08.483231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b81445b7-9089-4c63-9b81-ca7900ac52ed tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.219901 Aug 06 01:39:08.483796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 359/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:08 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:09.494142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:09.494757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:09.501327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:09.501811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:09.502255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:09.502963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:09.503418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:09.503544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:09.503952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:09.504049 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:09.510744 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:09.511228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:09.511657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:09.512337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:09.512787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:09.513235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:09.779465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:09.788457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-43a9667f-bdf0-4478-b1e3-c42f5890eb89 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.299072 Aug 06 01:39:09.789286 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 379/738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:09 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:09.794431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:09.802727 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-67e158dd-360e-4cce-bbad-c8cb55f2e231 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.302992 Aug 06 01:39:09.803303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 360/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:09 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:10.809886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:10.810469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:10.816863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:10.817578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:10.818086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:10.818780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:10.819244 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:10.819677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:10.822405 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:10.823014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:10.829371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:10.829856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:10.830291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:10.830978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:10.831432 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:10.831853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:10.847090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:11.234695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:11.241880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:11.243074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5c860500-53e8-461c-8b84-f604fd0ec8c5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.436838 Aug 06 01:39:11.243730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 380/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:10 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:11.250220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3b998217-2b98-455d-a7c7-5fbaad69e5c3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.431557 Aug 06 01:39:11.250789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 361/741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:10 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:12.264098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:12.264701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:12.267029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:12.271670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:12.272289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:12.273397 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:12.273901 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:12.274337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:12.275033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:12.275489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:12.275916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:12.278600 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:12.279090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:12.279535 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:12.280228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:12.280689 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:12.281141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:12.474792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:12.478205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:12.482329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6558bebc-837d-432d-bfe2-c03812744c7d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.222024 Aug 06 01:39:12.482900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 381/742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:12 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:12.486161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2be9db65-8d59-445e-92df-97f41724bd81 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.218598 Aug 06 01:39:12.486736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 362/743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:12 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:13.503836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:13.504452 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:13.508291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:13.508909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:13.511528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:13.512022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:13.512464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:13.513182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:13.513647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:13.514073 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:13.515460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:13.515945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:13.516404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:13.517117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:13.517572 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:13.517996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:13.518119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=100 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:13.710783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:13.715329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:13.719091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3fcc6aa1-20cb-466a-804d-996ee2458b9d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.218572 Aug 06 01:39:13.719679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 382/744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:13 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:13.723952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-843d5fe8-ff41-482e-9c61-1fa0b07165ca tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.220064 Aug 06 01:39:13.724538 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 363/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:13 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:14.739978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:14.740598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:14.744734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:14.745461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:14.747418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:14.747911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:14.748354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:14.749068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:14.749534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:14.749965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:14.751857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:14.752375 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:14.752810 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:14.753543 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:14.754001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:14.754425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:14.942561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:14.945389 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:14.951685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c693e923-16ee-41af-a0c3-9bac7161dba2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.210938 Aug 06 01:39:14.952548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 364/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:14 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:14.952675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-19e07001-f27e-4527-9486-d5c5dfe07936 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.216539 Aug 06 01:39:14.953408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 383/747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:14 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:15.974210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:15.974911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:15.975069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:15.975522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:15.977254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:15.982106 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:15.982439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:15.982594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:15.982929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:15.983055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:15.983368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:15.983710 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:15.984061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:15.984173 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:15.984519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:15.984629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:15.984945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:16.178131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:16.181435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:16.185687 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-dd38df1b-1328-4709-8e4a-48101b8cbffd tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.215719 Aug 06 01:39:16.186264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 384/748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:15 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:16.189394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-751be8ea-f80a-4f75-a58e-15d2c5ac5fe6 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.219675 Aug 06 01:39:16.189957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 365/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:15 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:17.206682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:17.207358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:17.210824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:17.211647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:17.215721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:17.216268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:17.216774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:17.218007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:17.218641 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:17.218777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:17.219237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:17.219546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:17.219684 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:17.220364 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:17.220814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:17.221545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:17.424025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:17.427461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:17.431636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c47efa42-b780-467c-9e8b-635824c2e2a1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.228931 Aug 06 01:39:17.432292 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 385/750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:17 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:17.435598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fc17b6e4-6ac2-4f54-aab8-00440461f0ce tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.228605 Aug 06 01:39:17.436162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 366/751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:17 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:17.437235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "name": "network-vif-plugged", "status": "completed", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:17.446501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:17.446975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:17.447456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:17.458749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] Creating event network-vif-plugged:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:39:17.463596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-73dffa25-43ca-4871-a0e2-fc7fbaa6f990 req-95530f04-99bc-4b4a-a606-a6bbad3586db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030202 Aug 06 01:39:17.464181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 386/752] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:18.451769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:18.452377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:18.457138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:18.458065 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:18.459202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:18.459695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:18.460129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:18.460824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:18.461301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:18.461718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:18.464518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:18.465007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:18.465483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:18.466178 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:18.466635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:18.467062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:18.656058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:18.659986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:18.664282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9ec36182-f06f-4044-b3b7-0885ee98a71f tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.216391 Aug 06 01:39:18.664852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 367/753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:18 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:18.668678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1c79d8b1-de01-432c-882a-bf2806d00e03 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.216301 Aug 06 01:39:18.669289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 387/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:18 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:19.684336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:19.685006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:19.690232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:19.690680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:19.693370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:19.694229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:19.694377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:19.694970 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:19.695419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:19.695836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:19.697574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:19.698393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:19.698835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:19.699531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:19.699994 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:19.700421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:19.890733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:19.897315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:19.898637 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-61336bc7-faa8-469c-bdbb-d73e1492250a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1359 microversion: 2.1 time: 0.218163 Aug 06 01:39:19.903002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 368/755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:19 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:19.905502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f482853d-b233-4658-83e9-4f854c9fb1d1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.219143 Aug 06 01:39:19.906057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 388/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:19 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:20.919692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:20.920295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:20.926921 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:20.927389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:20.927659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:20.927782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:20.928125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:20.928811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:20.929348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:20.929776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:20.934046 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:20.934528 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:20.934960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:20.935642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:20.936090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:20.936510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.120278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:21.127841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ff062221-3065-415e-92ba-e9bd1df75937 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1549 microversion: 2.1 time: 0.211981 Aug 06 01:39:21.128776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 369/757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:20 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:21.131840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:21.140570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8e8309da-e919-41b8-b6d6-7fd9ec97d9ae tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.217560 Aug 06 01:39:21.141287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 389/758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:20 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:21.149132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:21.149829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:21.155730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.156228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.156646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.157368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.157827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.158271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.288794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:21.296176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ba074f8e-8f15-4103-9de4-c94b425f8ed4 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1549 microversion: 2.1 time: 0.150830 Aug 06 01:39:21.296748 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 370/759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:21 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:21.315923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:21.321203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:21.321969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Searching by: {'deleted': False, 'project_id': '4db9537bd65748f6b43061f3530f6891'} {{(pid=124313) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 01:39:21.328549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.329026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.329511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.330214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.330662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.331084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.423318 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.multi_cell_list [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124313) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 01:39:21.514646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d6e02822-afbc-4c6f-8d68-f7302970017e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202294 Aug 06 01:39:21.515150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 390/760] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Aug 6 01:39:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:21.526609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:21.527228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:21.533092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.533598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.534018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.534708 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:21.535165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:21.536534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:21.663120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:21.670488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-82dec5b1-5c35-4c99-b6c4-d703228f60ed tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1549 microversion: 2.1 time: 0.147722 Aug 06 01:39:21.671050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 371/761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:21 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:22.161646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:22.162172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:22.169743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:22.170502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:22.171218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:22.171955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:22.172413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:22.172841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:22.301410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:22.309485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eb05ddd2-8288-4327-83bb-344fdc3d84f2 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.151813 Aug 06 01:39:22.310060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 391/762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:22 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:23.200217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6719523-ebf4-43e6-a9c5-5d64468c0199"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:23.202651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:23.208994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:23.209489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:23.209923 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:23.210607 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:23.211060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:23.211485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:23.330947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:23.331566 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:23.339164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:23.339587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:23.340028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:23.340746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:23.341313 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:23.341742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:23.482983 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:23.487641 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7d05f268-5d57-4e8d-9915-82d130ad18f0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291160 Aug 06 01:39:23.488472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 372/763] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:39:23 2022] POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:23.491556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ac9044f8-57c2-42c9-8b3f-d42b1c987ff4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.164908 Aug 06 01:39:23.492065 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 392/764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:23 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:24.512822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:24.513509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:24.519669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:24.520139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:24.520575 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:24.521604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:24.522064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:24.522492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:24.652777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:24.660989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-be2f796a-a2af-4e96-8f43-571627782a00 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.152977 Aug 06 01:39:24.662699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 373/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:24 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:25.682597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:25.683389 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:25.689831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:25.690313 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:25.690746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:25.691428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:25.691885 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:25.692309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:25.826227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:25.834663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-642e4ec1-8549-4062-bb46-3e074170b718 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.155952 Aug 06 01:39:25.835214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 393/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:25 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:26.855145 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:26.855745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:26.862201 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:26.862681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:26.863114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:26.863792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:26.864241 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:26.864989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:26.992448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:27.000674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-523e454a-016b-4329-98f5-14fa94009686 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.149337 Aug 06 01:39:27.001265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 374/767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:26 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:27.254135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:27.254652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:27.261324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:27.261804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:27.262264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:27.262941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:27.263388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:27.263805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:27.384686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lazy-loading 'services' on Instance uuid d25b0066-5e40-474a-94a9-d350a71af0ac {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:39:27.495810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f96be63b-021e-43ca-bc5e-bde6e8bb15c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments/a340c819-903b-46ce-990e-762d20d85a20" status: 202 len: 0 microversion: 2.1 time: 0.343070 Aug 06 01:39:27.496332 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 394/768] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:39:27 2022] DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments/a340c819-903b-46ce-990e-762d20d85a20 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:39:28.022279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:28.023422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:28.029996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:28.030481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:28.030914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:28.031599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:28.032056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:28.032479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:28.164387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:28.174031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3a1e3b33-3963-4c02-b579-b9d51e51606e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.155702 Aug 06 01:39:28.174605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 375/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:28 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:29.197187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:29.197912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:29.204040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:29.204517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:29.204947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:29.205650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:29.206104 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:29.206522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:29.337501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:29.345272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d7c2a85e-5f84-4fff-b525-1ac54502f474 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.153223 Aug 06 01:39:29.345832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 395/770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:29 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:30.366296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:30.366909 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:30.373636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:30.374123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:30.374564 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:30.375253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:30.375718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:30.376147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:30.507898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:30.510345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:30.517283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f0cf5f3c-5a25-477b-a3eb-aae7d9c0bf1e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.154896 Aug 06 01:39:30.517853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 376/771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:30 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:31.539081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:31.539776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:31.542135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:31.547783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:31.548274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:31.548712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:31.549430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:31.549888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:31.550316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:31.711153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:31.719302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-171a303c-9cc1-450e-967d-ff30c4c37aa9 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.184928 Aug 06 01:39:31.719868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 396/772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:31 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:32.126310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:32.126951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:32.135199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:32.135695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:32.136130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:32.136830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:32.137311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:32.137737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:32.270387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:32.278764 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-41225e87-a13b-41e2-966e-723f1a8d6f2e tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1595 microversion: 2.1 time: 0.156266 Aug 06 01:39:32.279333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 377/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:32 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:32.740891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:32.741587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:32.748615 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:32.749212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:32.749656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:32.750350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:32.750806 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:32.751232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:32.990600 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:32.999498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-01ae6ca0-f4bc-49b3-a3ee-7f21e6921e3f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.262531 Aug 06 01:39:33.000014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 397/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:32 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:33.901960 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:33.908453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:33.908939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:33.909409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:33.931600 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Going to try to stop instance {{(pid=124314) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 01:39:33.983095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ca9510c0-9d32-4de5-a2fc-ae8f91b4a127 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.085033 Aug 06 01:39:33.984101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 378/775] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:39:33 2022] POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:39:33.996805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:33.998327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:34.010502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:34.011428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:34.012342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:34.013602 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:34.014666 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:34.015743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:34.026069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:34.028517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:34.036188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:34.036733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:34.038454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:34.039397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:34.039861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:34.040475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:34.089823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:34.472888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:34.476578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:34.481772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3ab8e5a1-499a-489d-9981-ad3b4382052c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.492775 Aug 06 01:39:34.483139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 398/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:33 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:34.485849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bd23ae57-50a7-41e8-a8d6-98f9d32f21ec tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1736 microversion: 2.1 time: 0.467170 Aug 06 01:39:34.488447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:34.497826 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 379/777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:34 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1736 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:34.499573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:34.500289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:34.500956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:34.518417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] Creating event network-changed:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:39:34.529628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-65784a3c-2cd9-470d-afb3-e164cb55d813 req-7d7c75c3-2666-4584-bcd4-66188e482496 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040672 Aug 06 01:39:34.530381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 399/778] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:35.361198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-332483680"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:35.361739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:35.368377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.368871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.369332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.370017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.370473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.370899 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.498051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.network.security_group_api [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Adding security group 2b932084-aa7c-4170-a817-1c576692232d to port b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 Aug 06 01:39:35.510601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:35.511380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:35.517482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.518044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.518551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.519312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.519875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.520370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.722734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:35.730739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6c9fc489-1e89-43ce-91d9-1deca0b65617 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1716 microversion: 2.1 time: 0.225604 Aug 06 01:39:35.731304 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 400/779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:35 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1716 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:35.745187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:35.745187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:35.745187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.745187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.745618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.745618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.745793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.746210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.958881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:35.967052 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5b04b4f9-8d5e-4f1f-9c4e-690be1f523c0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.234684 Aug 06 01:39:35.967627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 401/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:35 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:35.972287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:35.972712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:35.979409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5032382b-1a37-4cec-bb29-311e065999ee tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action" status: 202 len: 0 microversion: 2.1 time: 0.621881 Aug 06 01:39:35.979576 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.979947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.980378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.981286 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.981739 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:35.982176 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:35.982457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 380/781] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:39:35 2022] POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:39:35.992137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:35.992754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:35.998956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:35.999647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.000580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.001318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.001778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.002235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.084464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] HTTP exception thrown: Cannot 'detach_volume' instance f5405de5-e911-4d71-9d79-bfd872cd2044 while it is in vm_state rescued Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Request method failure captured: Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments/4d41463e-cc20-42d7-994c-beb4dd095294 HTTP/1.1 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTMZEeLKmdAk2wwAQwH3HEqzFkDLkrWuGFB_kp5ALj0Tflf-cibgVNKTQIVAgoK82V5HDXLw41_PYvvRQl4PPOkL7CXXSflc41cG1JP1FEMYFATEzQiHwUbpItUPjmm2a5Z_QZj376Li7_YdymTh6GhuBF-FXSgH-y1e7WUkc4bVMY Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:39:36.088084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}] Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 37c704ce557c4f309cf00ef32646235f Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:39:36.089756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Cannot 'detach_volume' instance f5405de5-e911-4d71-9d79-bfd872cd2044 while it is in vm_state rescued Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'server_id': 'f5405de5-e911-4d71-9d79-bfd872cd2044', 'id': '4d41463e-cc20-42d7-994c-beb4dd095294'} Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:39:36.090592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f5405de5-e911-4d71-9d79-bfd872cd2044 while it is in vm_state rescued Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f5405de5-e911-4d71-9d79-bfd872cd2044 while it is in vm_state rescued Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:39:36.092001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Returning 409 to user: Cannot 'detach_volume' instance f5405de5-e911-4d71-9d79-bfd872cd2044 while it is in vm_state rescued {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:39:36.093018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-30b7c86c-579c-4a6b-bd25-bcecd747c2ac tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments/4d41463e-cc20-42d7-994c-beb4dd095294" status: 409 len: 152 microversion: 2.1 time: 0.121163 Aug 06 01:39:36.093018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 402/782] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:39:35 2022] DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments/4d41463e-cc20-42d7-994c-beb4dd095294 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 01:39:36.099014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:36.099677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:36.110986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.111479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.112489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.113233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.113693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.114129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.176577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:36.185907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7c3ddbf2-f553-453e-b9b0-c6c6a35d6698 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1760 microversion: 2.1 time: 0.198359 Aug 06 01:39:36.186361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7a1e85ce-3a80-42a0-89b9-d5778907dd2c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/action" status: 202 len: 0 microversion: 2.1 time: 0.090898 Aug 06 01:39:36.186963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 381/783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:35 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1760 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:36.187305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 403/784] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:39:36 2022] POST /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:39:36.197992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:36.198687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:36.205234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.205830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.206273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.207004 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.207457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.207873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.424755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:36.433776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8cef0dad-a677-4221-a1b5-e9fe645f5f56 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1724 microversion: 2.1 time: 0.239481 Aug 06 01:39:36.434626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 382/785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:36 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:39:36.561119 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:36.572040 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.572520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.573007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.584023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] Creating event network-changed:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:39:36.589509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-8c4eae9a-9fe7-4fde-9a3a-a7046eaa46a8 req-c6378772-5fe6-4da4-a170-25134d62844e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032844 Aug 06 01:39:36.590111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 404/786] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:36.989507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:36.990147 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:36.996410 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.996905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.997880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:36.998078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:36.998522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:36.998945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:37.136080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:37.143788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c601bc53-9180-4df7-9c6b-6ab14e7ab303 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.158139 Aug 06 01:39:37.144459 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 383/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:36 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:37.456320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:37.457004 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:37.463207 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:37.463684 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:37.464118 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:37.464788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:37.465270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:37.465690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:37.596080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:37.605016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5e115251-e370-4ecf-a85f-07b7959e3d0f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1724 microversion: 2.1 time: 0.152939 Aug 06 01:39:37.605604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 405/788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:37 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:38.165887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:38.166506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:38.173599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:38.174092 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:38.174532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:38.175226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:38.175683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:38.176107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:38.302583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:38.310175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b94e2166-3cb9-40ef-97fd-f155a8f35995 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.148804 Aug 06 01:39:38.310764 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 384/789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:38 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:38.627186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:38.627711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:38.634690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:38.635177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:38.635618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:38.636308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:38.636799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:38.637281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:38.766755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:38.775055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ab831281-01ab-49d3-bc55-35a3c8913c80 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1724 microversion: 2.1 time: 0.151787 Aug 06 01:39:38.775614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 406/790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:38 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:39.332405 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:39.333014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:39.339924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.340406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.340839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:39.341626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.342085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.342508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:39.473486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:39.482206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-24342d0b-8744-4b2e-b020-7c9b8e296e21 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.153618 Aug 06 01:39:39.482776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 385/791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:39 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:39.795771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:39.796442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:39.802668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.803148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.803583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:39.804260 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.804718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.805169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:39.934830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:39.942712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-47a033cb-2b57-432f-8d33-489973f7824e tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1730 microversion: 2.1 time: 0.150789 Aug 06 01:39:39.943276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 407/792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:39 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:39.963806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:39.964308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:39.970192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.970679 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.971114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:39.971804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:39.972264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:39.972694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:40.048770 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cfa37bab-8cf4-44ae-87e7-4eaaa14cb1a3 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089383 Aug 06 01:39:40.049439 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 386/793] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:39:39 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:40.503764 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:40.504435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:40.510500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:40.510987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:40.511426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:40.512111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:40.512574 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:40.512993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:40.735075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:40.743452 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e1d6397e-52d0-4b0d-952c-4a3f81e6c4b5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.243286 Aug 06 01:39:40.744025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 408/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:40 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:41.231657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:41.243304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:41.243863 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:41.244367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:41.255627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] Creating event network-changed:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:39:41.261291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-7ef802a0-7b91-4300-a05e-aba93d5aa1ab req-59169a0e-a4fd-4fbe-909d-89af5a2fe074 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033771 Aug 06 01:39:41.262078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 387/795] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:41.764815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:41.765441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:41.772367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:41.772941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:41.773509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:41.774378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:41.774895 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:41.775363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:41.917578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:41.925287 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-93dc7be8-dc2c-48b8-b7a1-5e93c44fe6eb tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.164412 Aug 06 01:39:41.926126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 409/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:41 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:42.949240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:42.950236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:42.956565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:42.957065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:42.957590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:42.958271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:42.958726 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:42.959146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:43.088789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:43.096178 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3b12eb4a-5c1a-4054-8120-bdf57d4c04c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.152422 Aug 06 01:39:43.096746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 388/797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:42 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:43.275793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:43.281308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=58 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:43.286836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:43.287315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:43.287752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:43.298727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] Creating event network-changed:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:39:43.303700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-70e31868-08c0-45bf-9095-8eda8a0cc3de req-512e9c8c-5a93-45ca-b136-e35a0d7fbe14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Aug 06 01:39:43.304790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 410/798] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:39:44.119704 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:44.120248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:44.127938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:44.128651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:44.129250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:44.129938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:44.130388 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:44.130804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:44.261938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:44.269434 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ba853a48-e9bf-4551-ace5-09235df3e56d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.155709 Aug 06 01:39:44.270001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 389/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:44 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:45.293205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:45.293901 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:45.299960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:45.300440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:45.300874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:45.301577 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:45.302032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:45.302459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:45.431743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:45.439175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-85be513e-7e59-4959-8613-efe4fd72ed61 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.151757 Aug 06 01:39:45.439740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 411/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:45 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:46.460211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:46.461140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:46.463568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=50 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:46.468812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:46.469327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:46.469765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:46.470455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:46.470912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:46.471337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:46.600566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:46.608612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-89d58ae5-70d8-405e-ac12-098a93ae1de9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.152349 Aug 06 01:39:46.609218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 390/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:46 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:47.630742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:47.631330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:47.638805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:47.639243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:47.639673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:47.640365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:47.640825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:47.641285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:47.767909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:47.775512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4ceffe74-6c0e-48ef-8204-446ce1199765 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.148631 Aug 06 01:39:47.776080 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 412/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:47 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:48.795654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:48.796295 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:48.802802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:48.803292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:48.803730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:48.805009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:48.805484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:48.805908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:48.935298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:48.942721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a3d783fc-e45c-4e92-8447-e8d4a0456f33 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.150913 Aug 06 01:39:48.943337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 391/803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:48 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:49.963133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:49.963740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:49.970068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:49.970546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:49.970977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:49.971657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:49.972106 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:49.972527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:50.100560 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:50.108730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-08fbda7d-fdf5-4799-a27c-e67f657fd4e4 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.149924 Aug 06 01:39:50.109337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 413/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:49 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:51.130431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:51.131109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:51.137583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:51.138069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:51.138506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:51.139194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:51.139649 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:51.140075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:51.268959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:51.276441 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4cf84577-4907-4984-9e10-6eff2595bd84 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.149962 Aug 06 01:39:51.277016 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 392/805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:51 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:52.298441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:52.299085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:52.306102 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:52.306593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:52.307026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:52.307712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:52.308168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:52.308593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:52.440050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:52.447725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-13efdc48-8c92-41bb-ab68-7ee6b8fef0e2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.153158 Aug 06 01:39:52.448286 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 414/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:52 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:53.469168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:53.469781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:53.476236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:53.476732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:53.477200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:53.477896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:53.478353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:53.478779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:53.606558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:53.608750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:53.616069 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8d21bfa0-404d-4f98-ba3b-d3e52b80eeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.150800 Aug 06 01:39:53.617261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 393/807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:53 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:54.639380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:54.639984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:54.646612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:54.647145 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:54.647541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:54.648545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:54.649001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:54.649447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:54.779337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:54.786771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5de07e8b-d730-430f-ab0e-8b55d764a2b2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1675 microversion: 2.1 time: 0.151220 Aug 06 01:39:54.787321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 415/808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:54 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:55.810339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:55.810949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:55.818273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:55.818758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:55.819212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:55.820472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:55.820925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:55.821454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:56.097661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:56.105590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2120fab7-1664-4275-b707-33e27fe49a55 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1652 microversion: 2.1 time: 0.299416 Aug 06 01:39:56.106155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 394/809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:55 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1652 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:56.127126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:39:56.134036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:56.134522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:56.134960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:56.138557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:56.160008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Going to try to start instance {{(pid=124313) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 01:39:56.202605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-85d323e7-3621-4e1f-b33b-ea3db719546c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.079198 Aug 06 01:39:56.203190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 416/810] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:39:56 2022] POST /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:39:56.212029 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:56.212645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:56.219103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:56.219707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:56.220279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:56.221066 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:56.221602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:56.222151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:56.356024 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:56.363694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fb43d193-ebb9-4648-93fb-95bc1d9ded1b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1661 microversion: 2.1 time: 0.156188 Aug 06 01:39:56.364261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 395/811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:56 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:57.389533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:57.390676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:57.398267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:57.398766 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:57.399199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:57.399899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:57.400361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:57.400788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:57.547145 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:57.554777 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-92bf976d-4cf2-4330-ba68-99c5dd1d8da2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1661 microversion: 2.1 time: 0.172194 Aug 06 01:39:57.555353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 417/812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:57 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:39:58.575685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:39:58.576299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:39:58.582738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:58.583227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:58.583668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:58.584361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:39:58.584822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:39:58.585376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:39:58.726269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:39:58.733933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2efd21ed-d202-4e56-a139-f1d1146a31b3 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1665 microversion: 2.1 time: 0.162132 Aug 06 01:39:58.734494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 396/813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:39:58 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:00.472831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:00.473410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:00.480470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.480954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.481428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.482117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.482601 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.483034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.510612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-976b2bd9-2b70-4b0b-9ac2-514d993c5969 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments/bd3f4145-bf48-47ae-b579-200dc1f5359d" status: 200 len: 194 microversion: 2.20 time: 0.041779 Aug 06 01:40:00.511190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 418/814] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Aug 6 01:40:00 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments/bd3f4145-bf48-47ae-b579-200dc1f5359d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:40:00.579973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:00.580466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:00.587617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.588124 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.588552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.589265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.589723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.590140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.669342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lazy-loading 'services' on Instance uuid 4ed60127-a6a5-49bb-ace7-03495a61fcf2 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:40:00.739921 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c57b0532-890a-43e9-9d72-737e87f4d928 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments/bd3f4145-bf48-47ae-b579-200dc1f5359d" status: 202 len: 0 microversion: 2.20 time: 0.163725 Aug 06 01:40:00.740630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 397/815] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Aug 6 01:40:00 2022] DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments/bd3f4145-bf48-47ae-b579-200dc1f5359d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:40:00.749583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:00.751995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:00.758656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.759153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.759593 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.760288 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:00.760747 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:00.761196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:00.790451 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-10be3065-54e2-43d4-b939-21029097fe6d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Aug 06 01:40:00.791018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 419/816] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Aug 6 01:40:00 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:40:01.803885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:01.807048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:01.813125 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:01.813607 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:01.814038 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:01.814875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:01.815413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:01.815911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:01.848115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-52360ecf-9613-4d6e-a255-994519daccdb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048924 Aug 06 01:40:01.848685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 398/817] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Aug 6 01:40:01 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:40:02.863575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:02.865726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:02.873069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:02.873567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:02.874003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:02.874685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:02.875170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:02.875592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:02.903747 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-25f01fd0-2937-4138-9285-ebb7dd510e75 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044131 Aug 06 01:40:02.904296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 420/818] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Aug 6 01:40:02 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:02.964512 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:02.965003 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:02.971328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:02.971813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:02.972248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:02.972934 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:02.973422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:02.973847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:03.001372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:40:03.073310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-293c09f7-c8ba-4111-b27a-509c22cfff44 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 204 len: 0 microversion: 2.20 time: 0.112397 Aug 06 01:40:03.074000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 399/819] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Aug 6 01:40:02 2022] DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 01:40:03.082848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:03.083461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:03.089356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:03.089841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:03.090279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:03.090961 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:03.091415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:03.091838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:03.222987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:03.231414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:03.232960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:03.234200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b9247418-def6-48a6-a635-0a4c0d687c38 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.155498 Aug 06 01:40:03.234848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 421/820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:03 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:04.259349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:04.260061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:04.266431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:04.266914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:04.267353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:04.268036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:04.268489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:04.268915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:04.400570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:04.408902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:04.410582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:04.411746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b92e8a2a-91f8-4f8b-a7c6-dd1a36596111 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.156801 Aug 06 01:40:04.412325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 400/821] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:04 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:05.434907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:05.435521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:05.441827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:05.442316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:05.442753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:05.443446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:05.443896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:05.444322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:05.694082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:05.702884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:05.704378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:05.705568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8aee0baf-fb1b-4dcc-89e4-8e1c4433e3cb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1721 microversion: 2.20 time: 0.274563 Aug 06 01:40:05.706132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 422/822] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:05 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:05.906643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:05.907215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:05.913164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:05.914279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:05.914719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:05.915423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:05.915884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:05.916309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:05.938844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lazy-loading 'flavor' on Instance uuid 90017aeb-8aa5-4956-984f-af411ab2a11b {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:40:06.019440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4ed32786-c21f-4ff5-9e0c-7a2a86e92b33 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "POST /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b/action" status: 202 len: 0 microversion: 2.1 time: 0.221460 Aug 06 01:40:06.020146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 401/823] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:40:05 2022] POST /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:40:06.029202 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:06.029821 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:06.038883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.039915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.040569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.041527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.042183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.042677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.473288 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:06.482047 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f1f7ea9-1bd6-4889-84c0-41ef1d4aa12e tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.456806 Aug 06 01:40:06.497242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 423/824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:06 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:40:06.549009 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed60127-a6a5-49bb-ace7-03495a61fcf2", "name": "network-vif-deleted", "tag": "9b3afced-3c87-49b0-a28a-cefda36b075b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:06.560979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.561609 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.562531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.575786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] Creating event network-vif-deleted:9b3afced-3c87-49b0-a28a-cefda36b075b for instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 on hv-cinder-85200 Aug 06 01:40:06.581448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-5e3306f4-d81c-4f53-bb9f-34a654cbf621 req-5b7ecefb-3a15-4c81-a381-ec47a6337217 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Aug 06 01:40:06.582236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 402/825] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:40:06.728495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:06.729143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:06.739559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.740066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.740846 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.741241 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.742002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.742438 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.775210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:06.775613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:06.776053 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:06.776507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lazy-loading 'fault' on Instance uuid 4ed60127-a6a5-49bb-ace7-03495a61fcf2 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:40:06.817069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:06.825845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:06.827358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:06.828518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7f3be638-4d7c-4715-886e-68d93e589638 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 200 len: 1371 microversion: 2.20 time: 0.104214 Aug 06 01:40:06.829110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 424/826] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:06 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:40:07.509226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:07.510413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:07.517968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:07.518482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:07.518916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:07.519637 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:07.520114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:07.520539 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:07.687447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:07.696241 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-595dc02a-0aa5-4076-bdc9-bbcab0460e61 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.195005 Aug 06 01:40:07.697251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 403/827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:07 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:07.852635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:07.853282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:07.859847 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:07.860335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:07.860776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:07.861503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:07.861963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:07.862388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:07.878421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 HTTP/1.1 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:40:07.880109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:40:07.881892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '4ed60127-a6a5-49bb-ace7-03495a61fcf2'} Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:40:07.882864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:40:07.884324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:40:07.885508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:40:07.885508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2818ffc9-a589-469f-94e9-618677fa6bd7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 404 len: 111 microversion: 2.20 time: 0.034352 Aug 06 01:40:07.885508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 425/828] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:07 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 01:40:07.892362 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c2100a58-5581-48e5-8060-1f12541b79a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '.version_select at 0x7fbfef676f70>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:07.920342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c2100a58-5581-48e5-8060-1f12541b79a5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816639418" status: 204 len: 0 microversion: 2.20 time: 0.031593 Aug 06 01:40:07.920984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 404/829] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Aug 6 01:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816639418 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 01:40:08.619858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6f31ffc8-7321-4ce0-81b0-70851d34fcf5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: .version_select at 0x7fbff7f21ca0>, body: {"keypair": {"name": "tempest-keypair-1297107040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpflBunm7jMRTL22txdBbNvIbm3JBZ/A/RGvwIVwCzIF84gQlOw9iW/vMYGX9+R7osJnfME+xRJ/UrywOO0NGhETIKzxMCI4YglNW6SSDw3X2trb0+BlwLns7MEq/2HCQ=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:08.634904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-6f31ffc8-7321-4ce0-81b0-70851d34fcf5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for project 16078c76f554419992faa7570fe5aba1. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:40:08.638681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-6f31ffc8-7321-4ce0-81b0-70851d34fcf5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for user 42ade772e11a4725928ab12d3bccc4a7 and project 16078c76f554419992faa7570fe5aba1. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:40:08.660400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6f31ffc8-7321-4ce0-81b0-70851d34fcf5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045259 Aug 06 01:40:08.660998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 426/830] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Aug 6 01:40:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 01:40:08.719128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:08.719745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:08.727151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:08.727724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:08.728165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:08.728867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:08.729345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:08.729771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:08.902975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:08.911358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ff7ff659-7a80-4881-ad1d-8172636f5d3f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.196734 Aug 06 01:40:08.911957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 405/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:08 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:09.933254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:09.933870 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:09.940466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:09.940954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:09.941411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:09.942199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:09.942545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:09.943051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:10.010596 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-98023006", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85316ce2-fda5-4fa0-8d98-fc3e80e275cc"}], "security_groups": [{"name": "tempest-securitygroup--884521123"}], "key_name": "tempest-keypair-1297107040", "user_data": "}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:10.086209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:10.093693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-60c54800-e485-421b-bdeb-01420aa56c65 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.165601 Aug 06 01:40:10.094262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 427/832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:09 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:10.119975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] validate_networks() for [('85316ce2-fda5-4fa0-8d98-fc3e80e275cc', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:40:10.493735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:40:10.494168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:40:10.494650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:40:10.495065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:40:10.495481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:40:10.504298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:10.504782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:10.505257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:10.505988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:10.506445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:10.506875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:10.524585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for project 16078c76f554419992faa7570fe5aba1. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:40:10.529236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Getting quotas for user 42ade772e11a4725928ab12d3bccc4a7 and project 16078c76f554419992faa7570fe5aba1. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:40:10.540613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:40:10.543006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:40:10.587877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-45766a47-8e71-4bb3-8a48-065f2d9a0ba1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.582189 Aug 06 01:40:10.588533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 406/833] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Aug 6 01:40:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 06 01:40:10.599297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:10.599911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:10.653907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:10.660991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:10.662559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:10.664168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-562061f6-1389-4955-82c1-99c9823a8c37 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1280 microversion: 2.20 time: 0.068253 Aug 06 01:40:10.664725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 428/834] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:10 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:11.114760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:11.115374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:11.125157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:11.125646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:11.126081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:11.126773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:11.127230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:11.127659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:11.268556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:11.276285 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b4efc292-b84c-4689-85cb-5d642e16594d tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.165843 Aug 06 01:40:11.276861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 407/835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:11 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:11.687273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:11.687880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:11.695466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:11.695968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:11.696407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:11.697166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:11.697624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:11.698051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:11.760606 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:11.769882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:11.771671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:11.773350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eb57d7a1-e731-4fe1-9f48-9a561e9e1ed3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1332 microversion: 2.20 time: 0.090494 Aug 06 01:40:11.773941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 429/836] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:11 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:12.297670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:12.298399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:12.305663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:12.306161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:12.306602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:12.307303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:12.307768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:12.308200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:12.323890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:12.527188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:12.534621 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e1bed428-cc16-42c8-a601-1cda49814d26 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.240812 Aug 06 01:40:12.535200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 408/837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:12 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:12.795959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:12.796713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:12.803095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:12.803581 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:12.804107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:12.805423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:12.805900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:12.806331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:13.044088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:13.052164 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:13.053888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:13.055553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c4b2c558-54a5-452f-9a68-764e5d33838f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.263473 Aug 06 01:40:13.056279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 430/838] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:12 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:13.339050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:13.350246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:13.350868 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:13.351701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:13.362802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] Creating event network-changed:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:40:13.369410 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-97eb1f54-a1ee-4341-abe1-0b81b4ddb01d req-4a408a0f-cd25-4bbc-95a5-b4f9af8dbf64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034623 Aug 06 01:40:13.370398 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 409/839] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:40:13.556484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:13.557130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:13.559270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:13.564798 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:13.565253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:13.565695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:13.566391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:13.566846 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:13.567270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:13.771425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:13.780203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d8ced837-4e42-494f-8b63-c35379267906 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.228200 Aug 06 01:40:13.780782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 431/840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:13 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:14.078674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:14.079376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:14.085963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:14.086552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:14.086988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:14.087668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:14.088117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:14.088536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:14.221401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:14.229338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:14.230841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:14.231955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3c2e9499-6a62-4535-bce8-b2baf86d5af8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.157502 Aug 06 01:40:14.232508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 410/841] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:14 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:14.802082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:14.802706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:14.809783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:14.810273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:14.810714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:14.811405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:14.811865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:14.812292 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:14.946262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:14.953716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e7e8a467-5b44-4237-a06d-0cfebed81fe7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.155499 Aug 06 01:40:14.954283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 432/842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:14 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:15.254232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:15.254841 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:15.261271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:15.261755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:15.262190 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:15.262878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:15.263335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:15.263757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:15.390230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:15.398740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:15.400254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:15.401397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bd465b08-8987-4f06-958a-fa5413c6abf7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.151037 Aug 06 01:40:15.402026 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 411/843] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:15 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:15.974865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:15.975475 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:15.981936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:15.982424 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:15.982861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:15.983546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:15.984002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:15.984429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:16.114026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:16.122412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-496cfc82-d115-48ed-954d-cbfd2f313e42 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.151371 Aug 06 01:40:16.122981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 433/844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:15 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:16.423760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:16.424367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:16.431874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:16.432358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:16.432790 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:16.433500 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:16.433971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:16.434394 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:16.561424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:16.569469 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:16.570987 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:16.572099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-37072173-32fd-42ae-b697-0bc739ffcad3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.152298 Aug 06 01:40:16.572661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 412/845] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:16 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:17.143731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:17.144278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:17.151609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:17.152101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:17.152541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:17.153385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:17.153742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:17.154590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:17.156918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:17.464957 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:17.472946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eac68897-c2b8-4064-a5e6-c732c571bb36 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.333047 Aug 06 01:40:17.473862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 434/846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:17 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:17.593634 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:17.594248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:17.596800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:17.603052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:17.603652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:17.604172 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:17.605154 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:17.605954 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:17.606390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:18.113854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:18.123715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:18.125282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:18.126413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-54968904-952b-4e2d-8a5b-70b1e3f7ac2e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.536767 Aug 06 01:40:18.127206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 413/847] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:17 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:18.495029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:18.495547 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:18.501905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:18.502386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:18.502819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:18.503503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:18.503993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:18.504391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:18.635297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:18.642564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2abe190d-8003-4b91-84a6-792ba461eb05 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.151759 Aug 06 01:40:18.643131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 435/848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:18 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:19.148976 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:19.149635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:19.155944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:19.156422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:19.156851 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:19.157550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:19.158002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:19.158422 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:19.283648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:19.291822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:19.293349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:19.294464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c46c407d-7644-41e9-a287-3612868e07e3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.149325 Aug 06 01:40:19.295015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 414/849] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:19 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:19.444050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "name": "network-vif-plugged", "status": "completed", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:19.453881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:19.454402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:19.454869 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:19.465810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] Creating event network-vif-plugged:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:40:19.470670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-0f157901-4fef-483f-a237-e7c2b723da9c req-470af232-e818-419f-a29c-bf27c84b25c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Aug 06 01:40:19.471263 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 436/850] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:40:19.664054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:19.664601 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:19.670481 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:19.671199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:19.671415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:19.672191 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:19.672644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:19.673084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:19.804658 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:19.812262 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e08daa06-0b51-488b-a6d0-1a6e9526d6cd tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.152359 Aug 06 01:40:19.812822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 415/851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:19 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:20.318306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:20.318910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:20.325079 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:20.325579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:20.326013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:20.326692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:20.327141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:20.327595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:20.457886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:20.465938 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:20.467431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:20.468533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-da87c5f5-28d7-414d-be0f-d216e0337f17 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.155155 Aug 06 01:40:20.469103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 437/852] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:20 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:20.837155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:20.837768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:20.840046 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:20.840816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:20.847294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:20.847781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:20.848215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:20.848910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:20.849396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:20.849820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:20.987099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:20.995012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7e48e1fb-b06c-4dd4-a437-1250c4ca00eb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.163427 Aug 06 01:40:20.995572 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 416/853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:20 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:21.495098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:21.495716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:21.497679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:21.503407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:21.503896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:21.504336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:21.505027 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:21.505510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:21.505938 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:21.631226 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:21.639729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:21.641274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:21.642390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-54b3a282-d24c-4429-9146-df73976c28f3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1405 microversion: 2.20 time: 0.152004 Aug 06 01:40:21.642955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 438/854] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:21 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:22.015757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:22.016417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:22.023504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.023991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.024420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.025126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.025578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.025994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.156562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:22.164848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5465094a-e3af-4edf-a94b-73b34f1423b9 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1508 microversion: 2.1 time: 0.152922 Aug 06 01:40:22.165435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 417/855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:22 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:22.184819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:22.185457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:22.191356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.191840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.192282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.192965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.193449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.193875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.221843 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124313) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 01:40:22.287476 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eacc320a-d152-4948-ab8f-029a345dc400 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "POST /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b/action" status: 202 len: 0 microversion: 2.1 time: 0.106381 Aug 06 01:40:22.288097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 439/856] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:40:22 2022] POST /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:40:22.296643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:22.297290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:22.303078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.303564 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.304040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.304814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.305317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.305743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.453288 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:22.462075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a0c1046b-0086-4223-8f1e-c3fe9d10167f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1516 microversion: 2.1 time: 0.169199 Aug 06 01:40:22.463055 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 418/857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:22 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:22.665674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:22.666366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:22.672368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.672975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.673521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.674215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.674679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.675105 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.807881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:22.816173 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:22.817863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:22.819203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-11cb63a7-ecb4-43f5-8408-cbbf216efe92 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1596 microversion: 2.20 time: 0.158257 Aug 06 01:40:22.820625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 440/858] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:40:22 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:40:22.842358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:22.842875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:22.848884 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.849409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.849829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.850505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:22.851122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:22.851558 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:22.936242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2e9f0327-a453-4550-aa79-cbf586d87403 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097507 Aug 06 01:40:22.937139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 419/859] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Aug 6 01:40:22 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:40:23.424315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "name": "network-vif-unplugged", "status": "completed", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:23.434611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:23.435251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:23.435783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:23.448088 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.compute.server_external_events [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] Unable to find a host for instance 90017aeb-8aa5-4956-984f-af411ab2a11b. Dropping event network-vif-unplugged {{(pid=124313) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 01:40:23.449316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-09cf39f8-7c91-487a-b4cd-8ca88c43fb90 req-677c8f4e-6101-471e-a0b1-fb4de92629bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028962 Aug 06 01:40:23.449984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 441/860] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 06 01:40:23.482836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:23.483404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:23.489448 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:23.489940 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:23.490582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:23.491796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:23.492273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:23.492707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:23.630839 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:23.639123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d6be13bd-3850-4cbd-8d03-93c0bc24d358 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1518 microversion: 2.1 time: 0.160747 Aug 06 01:40:23.639729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 420/861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:23 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:24.231172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:24.245952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:24.246433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:24.246861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:24.259019 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] Creating event network-changed:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:40:24.264329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-d78b4d89-e8ce-4f97-9899-70002c9dae5c req-6b3d62a0-9fbe-40bd-8ba8-0fd62e48da73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092969 Aug 06 01:40:24.265548 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 442/862] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:40:24.662181 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:24.664182 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:24.671168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:24.671968 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:24.672614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:24.673647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:24.674163 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:24.674814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:24.985263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:24.994913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ac45e0da-224c-42c9-97d3-f74744fa2cc7 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.336665 Aug 06 01:40:24.995581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 421/863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:24 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:26.023072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:26.023774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:26.030453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:26.030940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:26.031378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:26.032064 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:26.032523 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:26.032950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:26.166683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:26.174556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8a9cfa20-abd2-47b6-aa0b-ac1ae323edae tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.156256 Aug 06 01:40:26.175130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 443/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:26 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:27.195640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:27.196247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:27.202661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:27.203146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:27.203580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:27.204264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:27.204717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:27.205183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:27.333768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:27.341953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-13a38380-ad7a-4eee-9898-1b009d6b6254 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.150356 Aug 06 01:40:27.342523 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 422/865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:27 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:28.363273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:28.363865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:28.370748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:28.371235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:28.371672 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:28.372359 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:28.372814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:28.373281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:28.504458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:28.512111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-10e3aa1f-d161-4e48-9888-c3bb6edb5047 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.152837 Aug 06 01:40:28.512690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 444/866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:28 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:29.533411 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:29.534045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:29.540817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:29.541328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:29.541763 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:29.542444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:29.542898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:29.543314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:29.675985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:29.684233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9ade0bbe-92e0-4ed8-b5bd-a403868af567 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.154700 Aug 06 01:40:29.684833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 423/867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:29 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:30.705676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:30.706289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:30.713262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:30.713747 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:30.714186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:30.714878 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:30.715333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:30.715766 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:30.845965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:30.853428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-784c9eda-951e-4e4a-8091-76dfd26b4cf1 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.151561 Aug 06 01:40:30.853999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 445/868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:30 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:31.874536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:31.875139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:31.881614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:31.882302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:31.882623 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:31.883302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:31.883752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:31.884173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:32.016991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:32.024939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c5ea74c7-7e5b-4d4d-9b2d-507d0f7fa917 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.154228 Aug 06 01:40:32.025540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 424/869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:31 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:33.046473 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:33.047013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:33.053635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:33.055019 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:33.055457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:33.056141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:33.056599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:33.057022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:33.187625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:33.195910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-254e3110-411d-4ff5-b092-f741f0546db4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.153259 Aug 06 01:40:33.196481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 446/870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:33 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:34.217423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:34.218031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:34.224789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:34.225293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:34.225729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:34.227725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:34.228184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:34.228608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:34.364774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:34.372668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7e7e9c04-f2fd-45b9-b13f-250623ff4d18 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.159175 Aug 06 01:40:34.373268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 425/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:34 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:35.393559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:35.394184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:35.401710 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:35.402282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:35.402721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:35.403568 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:35.403887 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:35.404322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:35.537698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:35.545381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-573f8f29-d3fc-4631-9b1a-f13cf946fa84 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.155646 Aug 06 01:40:35.545966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 447/872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:35 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:35.559628 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "name": "network-vif-plugged", "status": "completed", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:35.570269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:35.570855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:35.571291 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:35.575294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:35.583307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] Creating event network-vif-plugged:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:40:35.588275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-57eff2e0-0fb6-4f07-a8d8-4574e51f7739 req-244b0798-44b6-4652-a74c-3e49e8dbe13b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Aug 06 01:40:35.588875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 426/873] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:40:36.567703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:36.568317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:36.575370 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:36.575857 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:36.576295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:36.576987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:36.577472 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:36.577899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:36.715071 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:36.722556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c5c7e6a9-6eb9-4049-8c8c-2faff72b1ba4 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1574 microversion: 2.1 time: 0.158746 Aug 06 01:40:36.723127 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 448/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:36 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:37.744149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:37.744837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:37.750860 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:37.751339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:37.751769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:37.752446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:37.752904 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:37.753348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:37.884257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:37.891757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-02105227-ab55-49b7-9f0e-09f172cdafc3 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1561 microversion: 2.1 time: 0.152919 Aug 06 01:40:37.892322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 427/875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:37 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:47.753029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:47.753558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:47.756101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:47.756758 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:47.763256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:47.763749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:47.764200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:47.764895 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:47.765388 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:47.765820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:47.846030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'services' on Instance uuid f5405de5-e911-4d71-9d79-bfd872cd2044 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:40:47.915913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-59ef0f02-cf30-4007-982f-fcac051b82e5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments/4d41463e-cc20-42d7-994c-beb4dd095294" status: 202 len: 0 microversion: 2.1 time: 0.166557 Aug 06 01:40:47.916516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 449/876] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:40:47 2022] DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments/4d41463e-cc20-42d7-994c-beb4dd095294 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:40:47.925144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:47.927333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:47.930267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=29 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:47.931032 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=7 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:47.937758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:47.938281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:47.938827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:47.939677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:47.940144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:47.940579 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:47.969916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a1509f47-23aa-4b8c-be82-f30153487ab5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048737 Aug 06 01:40:47.970451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 428/877] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:40:47 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:40:48.343726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:48.346093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:48.353084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.353575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.354013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:48.354702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.355160 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.355582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:48.425028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-676c23d3-6b67-4978-ae81-db27963c63e5 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action" status: 202 len: 0 microversion: 2.1 time: 0.085577 Aug 06 01:40:48.428536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 450/878] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:40:48 2022] POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:40:48.433882 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:48.434497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:48.440673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.441239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.441681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:48.442692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.443165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.443630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:48.592450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:48.601940 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-410ddd7a-61b3-463d-a16d-2f3756dda227 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1752 microversion: 2.1 time: 0.171165 Aug 06 01:40:48.602806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 429/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:48 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:40:48.983110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:48.985348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:48.993616 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.994377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.994810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:48.995508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:48.995959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:48.996380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:49.029033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-995863c9-9a57-478e-94c5-e4534c435963 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050700 Aug 06 01:40:49.029613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 451/880] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:40:48 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:40:49.623681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:49.624293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:49.630675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:49.631160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:49.631593 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:49.632286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:49.632736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:49.633203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:49.773385 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:49.781289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bf776d69-bcca-45cc-bb7a-96b74b96141d tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.161453 Aug 06 01:40:49.781858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 430/881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:49 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:50.042738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:50.044763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:50.051042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.051522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.051955 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.052640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.053112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.053536 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.082429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4c14524b-cad3-42e7-bdb3-92bac7aa5cb4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044777 Aug 06 01:40:50.082985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 452/882] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:40:50 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 01:40:50.163155 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:50.163650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:50.169815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.170310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.170783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.171484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.171981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.172409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.197896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:40:50.271955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5f594ead-cf1f-4c61-ae83-441155e1adb5 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 204 len: 0 microversion: 2.1 time: 0.112449 Aug 06 01:40:50.272650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 431/883] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:40:50 2022] DELETE /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:40:50.281294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:50.281915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:50.287783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.288273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.288714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.289432 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.290036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.290469 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.419341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:50.426825 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f632749-d0fd-418e-badc-26364b374a2a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1690 microversion: 2.1 time: 0.149399 Aug 06 01:40:50.427398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 453/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:50 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:50.804008 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:50.804710 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:50.811783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.812270 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.812709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.813456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:50.813937 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:50.814370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:50.957410 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:50.965403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ba04f5a1-cddd-4457-9a82-5afed7014e92 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.165646 Aug 06 01:40:50.965977 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 432/885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:50 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:51.447430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:51.448043 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:51.454445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:51.454934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:51.455371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:51.456061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:51.456516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:51.456943 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:51.584826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:51.592772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f2fa7d62-8cf2-4172-ab85-42f3ec691a5a tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1690 microversion: 2.1 time: 0.149247 Aug 06 01:40:51.593372 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 454/886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:51 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:51.986883 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:51.987497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:51.994245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:51.994731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:51.995168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:51.995862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:51.996318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:51.996747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:52.139199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:52.147174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-15a0967f-8707-4788-ba02-e21917e4e2c0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.164204 Aug 06 01:40:52.147748 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 433/887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:51 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:52.614156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:52.614762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:52.621531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:52.622009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:52.622445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:52.623121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:52.623571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:52.623990 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:52.755275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:52.763417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8d816417-99b3-45b7-86af-ca3e7b06c65b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1690 microversion: 2.1 time: 0.153134 Aug 06 01:40:52.763973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 455/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:52 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:53.170150 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:53.170694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:53.177950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:53.178567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:53.179094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:53.180779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:53.181306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:53.181907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:53.328895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:53.337406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-977f60ce-a462-4d2f-86ae-0320cd323ea6 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.172539 Aug 06 01:40:53.338020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 434/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:53 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:53.783954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:53.784573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:53.792611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:53.793138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:53.793578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:53.794291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:53.794750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:53.795181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:54.132216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:54.140265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-10cec289-e42b-4d11-b0f1-eaeb961bae58 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1690 microversion: 2.1 time: 0.360270 Aug 06 01:40:54.140858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 456/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:53 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1690 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:54.359594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:54.360219 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:54.366564 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:54.367057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:54.367498 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:54.368227 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:54.369074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:54.369505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:54.612553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5405de5-e911-4d71-9d79-bfd872cd2044", "name": "network-vif-deleted", "tag": "a7d680bd-aa42-4ab0-bbdd-41065b05019e"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:40:54.617279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:54.628123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:54.628496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bc95d9f9-20fb-4ad5-a7f4-b6e944a732a0 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.272474 Aug 06 01:40:54.628759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:54.629367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:54.629840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 435/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:54 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:40:54.657683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] Creating event network-vif-deleted:a7d680bd-aa42-4ab0-bbdd-41065b05019e for instance f5405de5-e911-4d71-9d79-bfd872cd2044 on hv-cinder-85200 Aug 06 01:40:54.663694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-43ce7b4b-47a3-473a-9399-80c69170ee42 req-d04c246a-0002-4547-858e-cc666b3b2e95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055211 Aug 06 01:40:54.664975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 457/892] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:40:55.163639 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:55.164258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:55.170751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:55.171239 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:55.171680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:55.172383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:55.172846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:55.173315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:55.210816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:55.211369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:55.211943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:55.212395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'fault' on Instance uuid f5405de5-e911-4d71-9d79-bfd872cd2044 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:40:55.266430 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:55.276038 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b954e39f-98d5-455d-aca8-84b2e60ba224 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 200 len: 1335 microversion: 2.1 time: 0.116510 Aug 06 01:40:55.277031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 436/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:55 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:55.652436 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:55.653168 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:55.659912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:55.660396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:55.660828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:55.661541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:55.661992 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:55.662414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:55.808509 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:55.816393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-202a6a9f-f724-4aac-b7e4-523f493243da tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.169004 Aug 06 01:40:55.816981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 458/894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:55 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:56.298486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:56.299106 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: f5405de5-e911-4d71-9d79-bfd872cd2044] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:56.305574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:56.306200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:56.306643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:56.307335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:56.307797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:56.308226 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:56.321890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] HTTP exception thrown: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Request method failure captured: Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 HTTP/1.1 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTMZEeLKmdAk2wwAQwH3HEqzFkDLkrWuGFB_kp5ALj0Tflf-cibgVNKTQIVAgoK82V5HDXLw41_PYvvRQl4PPOkL7CXXSflc41cG1JP1FEMYFATEzQiHwUbpItUPjmm2a5Z_QZj376Li7_YdymTh6GhuBF-FXSgH-y1e7WUkc4bVMY Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:40:56.323544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}] Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 37c704ce557c4f309cf00ef32646235f Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. Aug 06 01:40:56.324981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'f5405de5-e911-4d71-9d79-bfd872cd2044'} Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:40:56.325804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. Aug 06 01:40:56.327350 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:40:56.328787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Returning 404 to user: Instance f5405de5-e911-4d71-9d79-bfd872cd2044 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:40:56.328787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-54d10c2c-8b40-4727-b62e-c22b584919af tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044" status: 404 len: 111 microversion: 2.1 time: 0.030465 Aug 06 01:40:56.328787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 437/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:56 2022] GET /compute/v2.1/servers/f5405de5-e911-4d71-9d79-bfd872cd2044 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:40:56.333658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6b11b03a-fbaa-4936-b71c-b49dc3a4dd32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '.version_select at 0x7fbff7ef5ca0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:56.353824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6b11b03a-fbaa-4936-b71c-b49dc3a4dd32 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676609042" status: 202 len: 0 microversion: 2.1 time: 0.023865 Aug 06 01:40:56.354382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 459/896] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Aug 6 01:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676609042 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 01:40:56.837440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:56.838140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:56.844416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:56.844907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:56.845395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:56.846368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:56.846827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:56.847255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:57.049393 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:57.058318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5fec6042-9b68-4f94-a87e-0c5e3d65c8b9 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.225083 Aug 06 01:40:57.058907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 438/897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:56 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:58.080341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:58.080960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:58.087709 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:58.088202 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:58.088648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:58.089369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:58.089833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:58.090303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:58.244222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:58.252301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d15ee015-e77c-4713-adac-cc01abf45b00 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.176477 Aug 06 01:40:58.252869 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 460/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:58 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:59.263220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:59.264267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:59.270830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.271318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.271757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.272450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.272905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.273356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.274271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:59.275866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:59.282715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.283434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.283863 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.284557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.285010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.285457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.299275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:40:59.378764 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-63d9d27b-c94f-4787-98af-53db438c8739 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 204 len: 0 microversion: 2.1 time: 0.119576 Aug 06 01:40:59.379744 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 439/899] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:40:59 2022] DELETE /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:40:59.388769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:40:59.389504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:40:59.397100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.397603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.398036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.398823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:40:59.400482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:40:59.400482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:40:59.516684 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:59.524922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6ffa285f-c9e4-4b3e-8463-73b0516f869a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.254653 Aug 06 01:40:59.525728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 461/900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:59 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:40:59.561159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:40:59.568540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e08886e8-6093-4d82-97ea-a703025f6d35 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1509 microversion: 2.1 time: 0.184553 Aug 06 01:40:59.569116 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 440/901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:40:59 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:00.546194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:00.546810 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:00.553228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:00.553713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:00.554149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:00.554833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:00.555291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:00.555811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:00.591716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:00.592327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:00.600878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:00.601418 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:00.601862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:00.602703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:00.603231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:00.603666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:00.622210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:00.761738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:00.769695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-374a89ea-46ad-4126-b62e-73a339455efa tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1757 microversion: 2.1 time: 0.227309 Aug 06 01:41:00.770271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 462/902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:00 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:00.782983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:00.790436 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ca51636f-d018-4bd9-9d2a-14b6964f5000 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1509 microversion: 2.1 time: 0.203556 Aug 06 01:41:00.790995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 441/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:00 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:01.423464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acdfef-0b50-4561-8f9e-c9159b16d014", "name": "network-vif-deleted", "tag": "1da54cea-8621-4d67-b9fe-0f749fe8b99d"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:01.434533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.435262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.435918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.448970 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] Creating event network-vif-deleted:1da54cea-8621-4d67-b9fe-0f749fe8b99d for instance d7acdfef-0b50-4561-8f9e-c9159b16d014 on hv-cinder-85200 Aug 06 01:41:01.454133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-a7d41a07-6d90-4c0f-938c-bcf2c24d20f8 req-de5d76f2-94b6-4c4f-a870-1496ade4034c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Aug 06 01:41:01.454847 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 463/904] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:01.791821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:01.792453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:01.799063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.799569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.800025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.800732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.801214 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.801650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.812652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:01.813537 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:01.820340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.821022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.822113 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.822999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.823470 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.823897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.854556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:01.855048 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:01.855486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:01.855932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'fault' on Instance uuid d7acdfef-0b50-4561-8f9e-c9159b16d014 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:41:01.909386 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:01.918124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1ec1ed70-9411-4713-ab05-05e5bac10304 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1312 microversion: 2.1 time: 0.110145 Aug 06 01:41:01.918704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 464/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:01 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:41:01.968080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:01.976228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9dffc32b-4de9-4b93-bac7-8ff564b7bd8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1760 microversion: 2.1 time: 0.188457 Aug 06 01:41:01.976907 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 442/906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:01 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:02.139582 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:02.141748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:02.147565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.148045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.148483 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.149199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.149665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.150136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.174358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:02.179773 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ba2c01ae-2ed2-4984-a5f9-5b34eeffc612 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044093 Aug 06 01:41:02.180331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 465/907] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:41:02 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:41:02.241235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:02.241690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:02.248533 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.249028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.249494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.250185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.250643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.251071 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.277729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:41:02.352166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-310febc0-c585-4e56-a7dd-14a4c9896857 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 204 len: 0 microversion: 2.1 time: 0.114613 Aug 06 01:41:02.353391 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 443/908] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:41:02 2022] DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:41:02.361832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:02.362439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:02.372409 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.372937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.373371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.374289 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.374532 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.374954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.511352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:02.518835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-64537159-b084-4ec0-8737-cac6f43e0169 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1671 microversion: 2.1 time: 0.160994 Aug 06 01:41:02.519405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 466/909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:02 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:02.939931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:02.940655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:02.947671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.948153 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.948584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.949302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.949755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.950178 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.981376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:02.981854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:02.982284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:02.982723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lazy-loading 'fault' on Instance uuid d7acdfef-0b50-4561-8f9e-c9159b16d014 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:41:03.023844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:03.032027 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b0b10223-a1a4-40df-ba04-aee2b232b76c tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 200 len: 1312 microversion: 2.1 time: 0.096274 Aug 06 01:41:03.032603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 444/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:02 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:03.539780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:03.540577 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:03.547030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:03.547514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:03.547953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:03.548637 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:03.549120 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:03.549550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:03.676205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:03.684587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1369b607-4f1f-463e-8b0f-cf64d39395dc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1671 microversion: 2.1 time: 0.148712 Aug 06 01:41:03.685174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 467/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:03 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:04.051685 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:04.052266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d7acdfef-0b50-4561-8f9e-c9159b16d014] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:04.058655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.059146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.059577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.060258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.060709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.061157 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.074496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] HTTP exception thrown: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Request method failure captured: Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 HTTP/1.1 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTMZEeLKmdAk2wwAQwH3HEqzFkDLkrWuGFB_kp5ALj0Tflf-cibgVNKTQIVAgoK82V5HDXLw41_PYvvRQl4PPOkL7CXXSflc41cG1JP1FEMYFATEzQiHwUbpItUPjmm2a5Z_QZj376Li7_YdymTh6GhuBF-FXSgH-y1e7WUkc4bVMY Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:41:04.076205 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}] Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 37c704ce557c4f309cf00ef32646235f Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. Aug 06 01:41:04.077896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'd7acdfef-0b50-4561-8f9e-c9159b16d014'} Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:41:04.078871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. Aug 06 01:41:04.080344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:04.081821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Returning 404 to user: Instance d7acdfef-0b50-4561-8f9e-c9159b16d014 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:41:04.081821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8823744e-ec04-4bb6-9e05-b06584e58f8b tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014" status: 404 len: 111 microversion: 2.1 time: 0.029841 Aug 06 01:41:04.081821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 445/912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:04 2022] GET /compute/v2.1/servers/d7acdfef-0b50-4561-8f9e-c9159b16d014 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:04.088501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:04.089084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:04.094946 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.095503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.096020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.096793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.097339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.097829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.124039 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:41:04.206314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-91f5b17f-a2f5-411f-b8b7-9353b5767fd4 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 204 len: 0 microversion: 2.1 time: 0.122783 Aug 06 01:41:04.207025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 468/913] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:41:04 2022] DELETE /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:41:04.218739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:04.219563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:04.225700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.226260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.226760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.228206 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.228731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.229275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.418661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:04.426192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fa558ea2-cfb5-4b69-8707-70b7b977ae1f tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.212885 Aug 06 01:41:04.426848 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 446/914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:04 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:04.706485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:04.707183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:04.715697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.716433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.716944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.717789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.718539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.719042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.799690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25b0066-5e40-474a-94a9-d350a71af0ac", "name": "network-vif-deleted", "tag": "052f72bc-baad-4627-a6fd-ec1944c9e611"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:04.804132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:04.810901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:04.811387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:04.811822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:04.812508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a8f0b2ca-fae9-4fba-b9bc-2f6cd6e3077d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 200 len: 1604 microversion: 2.1 time: 0.110116 Aug 06 01:41:04.813200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 469/915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:04 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 1604 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:41:04.824169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] Creating event network-vif-deleted:052f72bc-baad-4627-a6fd-ec1944c9e611 for instance d25b0066-5e40-474a-94a9-d350a71af0ac on hv-cinder-85200 Aug 06 01:41:04.829273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-397da2b3-febc-44e5-a33c-cd91ec2e9548 req-3bd1e16b-b769-4187-b597-239beb748bbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034520 Aug 06 01:41:04.830025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 447/916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:05.446111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:05.446755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:05.452735 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:05.453268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:05.453706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:05.454401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:05.454858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:05.455285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:05.665583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c704ce557c4f309cf00ef32646235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6efff0f0d482180e74f1cd075b592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:05.674142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c76b8c71-5947-473c-b8a5-595cb958e7f1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 200 len: 1522 microversion: 2.1 time: 0.231786 Aug 06 01:41:05.675054 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 470/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:05 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:05.835235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:05.836699 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:05.844912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:05.845511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:05.846052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:05.846815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:05.847343 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:05.847873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:05.863885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac HTTP/1.1 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:41:05.865587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:41:05.867245 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'd25b0066-5e40-474a-94a9-d350a71af0ac'} Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:41:05.868315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:41:05.870054 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:41:05.872812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:41:05.873825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c6042a60-8409-4662-b009-13e81d134097 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 404 len: 111 microversion: 2.1 time: 0.043136 Aug 06 01:41:05.874555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 448/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:05 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:05.883461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7bfca6e4-2814-4d7b-8ab9-309ad2dc6071 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '.version_select at 0x7fbff4073700>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:05.905239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7bfca6e4-2814-4d7b-8ab9-309ad2dc6071 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285877458" status: 202 len: 0 microversion: 2.1 time: 0.025677 Aug 06 01:41:05.905902 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 471/919] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Aug 6 01:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285877458 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:41:06.565076 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c870a0f4-adf0-497e-84fc-c79d4fcf6a93 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: .version_select at 0x7fbff408fca0>, body: {"keypair": {"name": "tempest-keypair-1022976735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzmRvi/KTIE1Lx1TVWjF0+wTwZFqjJwMMAVIIypRW6h4JmStt+dzDufgeT1KejS68cbv4yiEctlPpye7y7iLSmuPRFafRHzswa5wOEw019CJW37h2IewP9mkANJFF/TyA=="}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:06.583377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-c870a0f4-adf0-497e-84fc-c79d4fcf6a93 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:41:06.587906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-c870a0f4-adf0-497e-84fc-c79d4fcf6a93 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for user 2455ea8abba547669fe22d2065a726c6 and project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:41:06.613738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c870a0f4-adf0-497e-84fc-c79d4fcf6a93 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053566 Aug 06 01:41:06.614324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 449/920] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:41:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:06.695742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:06.696719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] [instance: d9cee84e-9fda-4bcb-9513-e8b6e343ffaa] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:06.702948 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:06.703589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:06.704061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:06.704760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:06.705248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:06.705674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:06.720728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] HTTP exception thrown: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Request method failure captured: Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa HTTP/1.1 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTMZEeLKmdAk2wwAQwH3HEqzFkDLkrWuGFB_kp5ALj0Tflf-cibgVNKTQIVAgoK82V5HDXLw41_PYvvRQl4PPOkL7CXXSflc41cG1JP1FEMYFATEzQiHwUbpItUPjmm2a5Z_QZj376Li7_YdymTh6GhuBF-FXSgH-y1e7WUkc4bVMY Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:41:06.722706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5be6efff0f0d482180e74f1cd075b592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5be6efff0f0d482180e74f1cd075b592"}]}] Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 5be6efff0f0d482180e74f1cd075b592 Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1882250416 Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 37c704ce557c4f309cf00ef32646235f Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1882250416-project Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. Aug 06 01:41:06.724331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd9cee84e-9fda-4bcb-9513-e8b6e343ffaa'} Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:41:06.729934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. Aug 06 01:41:06.731275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:41:06.733248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] Returning 404 to user: Instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:41:06.733248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e8ad4b0-545e-48d2-b58a-ff935ccce8e1 tempest-ServerRescueNegativeTestJSON-1882250416 tempest-ServerRescueNegativeTestJSON-1882250416-project] 10.222.0.26 "GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa" status: 404 len: 111 microversion: 2.1 time: 0.032588 Aug 06 01:41:06.733248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 472/921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:06 2022] GET /compute/v2.1/servers/d9cee84e-9fda-4bcb-9513-e8b6e343ffaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:06.845931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cee84e-9fda-4bcb-9513-e8b6e343ffaa", "name": "network-vif-deleted", "tag": "51c934c5-29f0-4f84-b863-02666b538d5b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:06.861100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:06.861821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:06.862456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:06.880202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] Creating event network-vif-deleted:51c934c5-29f0-4f84-b863-02666b538d5b for instance d9cee84e-9fda-4bcb-9513-e8b6e343ffaa on hv-cinder-85200 Aug 06 01:41:06.888061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-1a6717ac-f885-42f1-b41d-299da41f339d req-e818d44f-08b5-465a-b04a-745fe6c29101 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045541 Aug 06 01:41:06.889576 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 450/922] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:08.344623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1041773069", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ba03ae0-258d-4135-90c0-73573adb81fa"}], "security_groups": [{"name": "tempest-securitygroup--1497369583"}], "key_name": "tempest-keypair-1022976735", "user_data": "}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:08.448758 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] validate_networks() for [('8ba03ae0-258d-4135-90c0-73573adb81fa', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:41:08.859589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:41:08.860144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:41:08.860622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:41:08.861026 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:41:08.861488 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:41:08.871628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:08.872242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:08.872728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:08.873492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:08.873947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:08.874608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:08.891911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:41:08.895840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Getting quotas for user 2455ea8abba547669fe22d2065a726c6 and project 4bd83104ff2241519bcdd4e232eb6895. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:41:08.906968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:41:08.909349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:41:08.959799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-40438249-99eb-4635-9b38-607fb8db820e tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619266 Aug 06 01:41:08.966424 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 473/923] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:41:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:41:08.972002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e0884c73-77a8-4cf5-bc5f-076ad4446195 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:08.972696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e0884c73-77a8-4cf5-bc5f-076ad4446195 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:09.050057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e0884c73-77a8-4cf5-bc5f-076ad4446195 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:09.058101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e0884c73-77a8-4cf5-bc5f-076ad4446195 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1238 microversion: 2.1 time: 0.090191 Aug 06 01:41:09.058689 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 451/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:08 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:10.079502 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:10.080121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:10.087760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:10.088521 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:10.089169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:10.090067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:10.090782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:10.091431 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:10.236256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:10.246450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-70ebe7a8-9955-4b9b-b570-e3f00bd6288a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1298 microversion: 2.1 time: 0.171223 Aug 06 01:41:10.247047 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 474/925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:10 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:11.269599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:11.270296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:11.282847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:11.286104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:11.286843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:11.287956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:11.289075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:11.291353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:11.505915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:11.515747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-be5b9ae5-1f13-4336-89d1-336977a10f04 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.250448 Aug 06 01:41:11.516482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 452/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:11 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:11.798730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e863f95-ad5e-490d-8473-00f2ed18de58", "tag": "2b2d0a1e-e59a-4c90-9b26-15dbaed691f5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:11.811153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:11.811935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:11.812368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:11.826060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] Creating event network-changed:2b2d0a1e-e59a-4c90-9b26-15dbaed691f5 for instance 8e863f95-ad5e-490d-8473-00f2ed18de58 on hv-cinder-85200 Aug 06 01:41:11.831025 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-77684559-1070-4aea-b2fe-bc7803fdabe8 req-b8a0095a-7000-4cc8-b3e5-7742159cdf66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036275 Aug 06 01:41:11.831751 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 475/927] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:12.537563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:12.538174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:12.546415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:12.546906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:12.547337 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:12.548236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:12.548695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:12.549141 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:12.701730 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:12.709630 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cb133b48-36ee-484c-8025-eb2162ece328 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.176000 Aug 06 01:41:12.710457 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 453/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:12 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:13.737111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:13.738490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:13.749427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:13.750737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:13.751407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:13.752433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:13.753075 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:13.753665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:13.911771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:13.920546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c5db436b-264a-423d-a121-15ce28676354 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.190015 Aug 06 01:41:13.922034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 476/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:13 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:14.942515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:14.943843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:14.951166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:14.952548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:14.953351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:14.954250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:14.954886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:14.955484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:15.246215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:15.254820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9473da2d-ab40-4a18-8cc3-9aa7275e0ee5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.316834 Aug 06 01:41:15.255692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 454/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:14 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:16.221998 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d4580387-408a-4050-8d24-1247dc38b177 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: .version_select at 0x7fbff7f04af0>, body: {"keypair": {"name": "tempest-keypair-889046632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwG91s9vrjDMhORVpAbhtitiOy4ZOCQqVKgOAmGtNrL+TwWxqvOB+cvZezripgrKSLWBkRJy2j+De9WUJU/rzOJ5CTXuVDj7CShH0TgUelWpzcL/Dj5E6W8km5r2Z/joQ=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:16.241171 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-d4580387-408a-4050-8d24-1247dc38b177 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:41:16.246200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-d4580387-408a-4050-8d24-1247dc38b177 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:41:16.273302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d4580387-408a-4050-8d24-1247dc38b177 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.213058 Aug 06 01:41:16.274231 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 477/931] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:41:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:16.288307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:16.288932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:16.304164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:16.304836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:16.305955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:16.306951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:16.307913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:16.308529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:16.468073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:16.476324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f5d30ab3-2b79-4da9-b478-ce0a7ab99726 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.203169 Aug 06 01:41:16.477314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 455/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:16 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:41:17.500636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:17.501728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:17.515839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:17.516973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:17.517517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:17.518784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:17.518890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:17.519272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:17.562796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-817668320", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "298c8e04-2f72-4e6a-a959-fe6b3ec17737"}], "security_groups": [{"name": "tempest-securitygroup--962974580"}], "key_name": "tempest-keypair-889046632", "user_data": "}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:17.724659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] validate_networks() for [('298c8e04-2f72-4e6a-a959-fe6b3ec17737', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:41:17.725272 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:17.735236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-67d4d37c-a827-4149-b5d5-0a8b9b6374c6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.241267 Aug 06 01:41:17.749153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 478/933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:17 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:18.121356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:41:18.121978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:41:18.122447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:41:18.122856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:41:18.123266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:41:18.125613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:18.134603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:18.135086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:18.135837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:18.136594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:18.137257 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:18.138012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:18.157696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:41:18.162047 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:41:18.174446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:41:18.176873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:41:18.226038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e863f95-ad5e-490d-8473-00f2ed18de58", "name": "network-vif-plugged", "status": "completed", "tag": "2b2d0a1e-e59a-4c90-9b26-15dbaed691f5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:18.226284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-da8a24ad-2c30-4f89-9d93-927680953fbf tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667666 Aug 06 01:41:18.226694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 456/934] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:41:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:41:18.233116 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:18.238060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0a0e3b8c-1b08-4f68-a298-7cccaefa0543 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:18.238869 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0a0e3b8c-1b08-4f68-a298-7cccaefa0543 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:18.239611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:18.240101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:18.240541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:18.277308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] Creating event network-vif-plugged:2b2d0a1e-e59a-4c90-9b26-15dbaed691f5 for instance 8e863f95-ad5e-490d-8473-00f2ed18de58 on hv-cinder-85200 Aug 06 01:41:18.283425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-efddbdf1-ffe9-41a3-8fe4-2c6d8741414e req-4dff98ab-10ff-478a-ab29-cb345ca5d7e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060395 Aug 06 01:41:18.284415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 479/935] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:18.316629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0a0e3b8c-1b08-4f68-a298-7cccaefa0543 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:18.324656 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0a0e3b8c-1b08-4f68-a298-7cccaefa0543 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1240 microversion: 2.1 time: 0.090257 Aug 06 01:41:18.347999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 457/936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:18 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:18.757339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:18.758068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:18.765209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:18.769580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:18.769580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:18.769580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:18.769580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:18.770203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:18.883579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:18.909617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:18.918232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-508e2873-708f-49c9-85b3-1e88bab7e803 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.166073 Aug 06 01:41:18.918918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 480/937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:18 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:19.347955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:19.348598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:19.355992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:19.356484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:19.356927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:19.357935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:19.358758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:19.359351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:19.425189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:19.432682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8a545ee8-e02a-4b5f-9a89-b923b6856e2b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1236 microversion: 2.1 time: 0.088712 Aug 06 01:41:19.433275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 458/938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:19 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:19.939492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:19.940099 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:19.946689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:19.947167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:19.947623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:19.948305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:19.948764 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:19.949216 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:20.231452 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:20.238721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ec4bd4b5-fcd9-4bb9-9f36-c618ba39e5d6 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1364 microversion: 2.1 time: 0.303138 Aug 06 01:41:20.239321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 481/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:19 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:20.454118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:20.454736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:20.462101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:20.462709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:20.463014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:20.463711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:20.464176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:20.464605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:20.527783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:20.535369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fa3a366f-8fe8-40c8-91d9-78dff6b5b0cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1300 microversion: 2.1 time: 0.085088 Aug 06 01:41:20.535931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 459/940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:20 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:21.259729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:21.260344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:21.266682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.267174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.267614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.268308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.268768 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.269243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.484935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:21.492363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-af291e69-74b5-4564-bd98-1b4da05476b8 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1551 microversion: 2.1 time: 0.236464 Aug 06 01:41:21.507712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 482/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:21 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1551 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:21.515160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:21.515772 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:21.530051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.530543 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.531015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.531678 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.532130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.532559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.558799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:21.560716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:21.567442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.568852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.569861 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.571518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:21.572083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:21.572562 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:21.663662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:21.672569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5fa7b6cf-236a-42b1-bba5-8f6c7c1aa5b3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1298 microversion: 2.1 time: 0.119864 Aug 06 01:41:21.673265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 483/942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:21 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:21.697577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-52e5be44-6270-4b19-8c83-31f72c016ef2 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188186 Aug 06 01:41:21.698404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 460/943] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:41:21 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:22.653213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83bb86e-3508-4057-a16d-d43f33bd56f2", "tag": "9f7b31b0-6620-4723-98f0-bc0060df7aa2"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:22.667579 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:22.668517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:22.669319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:22.691041 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e863f95-ad5e-490d-8473-00f2ed18de58", "tag": "2b2d0a1e-e59a-4c90-9b26-15dbaed691f5"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:22.697815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] Creating event network-changed:9f7b31b0-6620-4723-98f0-bc0060df7aa2 for instance b83bb86e-3508-4057-a16d-d43f33bd56f2 on hv-cinder-85200 Aug 06 01:41:22.712731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:22.713670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-cc889155-1fb8-4015-92ce-e2d2d05c1cbb req-725872ab-4666-4251-b847-16ec89a1424b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060770 Aug 06 01:41:22.714369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 484/944] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:22.716040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:22.716484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:22.724544 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:22.725267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:22.729467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] Creating event network-changed:2b2d0a1e-e59a-4c90-9b26-15dbaed691f5 for instance 8e863f95-ad5e-490d-8473-00f2ed18de58 on hv-cinder-85200 Aug 06 01:41:22.734556 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:22.735045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:22.735171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-342c0523-6d92-4a1e-b4b9-d1aa0d4983d5 req-dd1aef74-6548-4471-99b0-c3e001756d75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048127 Aug 06 01:41:22.735480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:22.735910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 461/945] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:41:22.736197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:22.736625 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:22.737361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:23.077503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:23.089836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a52fdeac-fd2c-4abc-9e79-09d4e84d41b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.373757 Aug 06 01:41:23.090972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 485/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:22 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:24.112050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:24.112676 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:24.119762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:24.120330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:24.120771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:24.121504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:24.122058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:24.122476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:24.256592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:24.264191 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fd1a08d6-1b57-49e3-90b3-5149f768beb8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.156901 Aug 06 01:41:24.264771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 462/947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:24 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:41:25.285687 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:25.286296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:25.293148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:25.293634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:25.294188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:25.295021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:25.295492 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:25.295923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:25.300107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:25.426193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:25.434308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f6b78f62-2070-4863-ba17-3546edefcc1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.152517 Aug 06 01:41:25.434871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 486/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:25 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:26.454485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:26.455101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:26.462391 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:26.462880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:26.463320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:26.464022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:26.464482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:26.464913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:26.484025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:26.618488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:26.626105 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c0f4c60b-6fca-4cec-b2bb-da562a5c7fb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.175626 Aug 06 01:41:26.626681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 463/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:26 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:27.647153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:27.647677 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:27.649813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=10 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:27.655135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:27.655615 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:27.656049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:27.656728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:27.657209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:27.657632 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:27.789855 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:27.797364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3d2215a7-0855-4ea9-abf1-f523d84dba67 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.154100 Aug 06 01:41:27.797926 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 487/950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:27 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:28.818183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:28.819444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:28.823683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:28.824456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=14 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:28.828761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:28.829315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:28.829775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:28.830702 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:28.831161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:28.831587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:28.964913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:28.972282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7c246322-6cc7-4e2b-9d5d-0b8d84054dc5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.157911 Aug 06 01:41:28.972835 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 464/951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:28 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:29.991900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:29.992749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:29.999461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:29.999945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:30.000378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:30.001090 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:30.001551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:30.001979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:30.132012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:30.140213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-adc54a78-9a6e-4ca9-a754-f6f2b6cb63c0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.152189 Aug 06 01:41:30.140784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 488/952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:29 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:30.256412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83bb86e-3508-4057-a16d-d43f33bd56f2", "name": "network-vif-plugged", "status": "completed", "tag": "9f7b31b0-6620-4723-98f0-bc0060df7aa2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:30.267289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:30.267756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:30.268215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:30.279400 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] Creating event network-vif-plugged:9f7b31b0-6620-4723-98f0-bc0060df7aa2 for instance b83bb86e-3508-4057-a16d-d43f33bd56f2 on hv-cinder-85200 Aug 06 01:41:30.284329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-98e07219-8ae0-42f6-9a31-5a57c3edd49b req-ce71cbf0-be3e-4130-99f6-1961eae71de9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Aug 06 01:41:30.284991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 465/953] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:31.162014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:31.162632 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:31.169721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:31.170211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:31.170652 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:31.171374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:31.171838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:31.172264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:31.299555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:31.307023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-56726d0b-596b-41c0-b518-36565107859e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1365 microversion: 2.1 time: 0.148851 Aug 06 01:41:31.307598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 489/954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:31 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:32.327983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:32.328683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:32.334985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:32.335472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:32.335912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:32.336625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:32.337100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:32.337531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:32.470087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:32.478348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7a879f07-b452-482b-9ba7-5801fbf2e1e8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1554 microversion: 2.1 time: 0.155153 Aug 06 01:41:32.478912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 466/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:41:32 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:41:32.498453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:32.499009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:32.505636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:32.506205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:32.506637 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:32.507321 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:32.507803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:32.508666 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:32.584947 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7a44375e-bc76-4598-81d3-801179996dde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090534 Aug 06 01:41:32.585590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 490/956] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:41:32 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:33.731532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83bb86e-3508-4057-a16d-d43f33bd56f2", "tag": "9f7b31b0-6620-4723-98f0-bc0060df7aa2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:33.741415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:33.741967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:33.744975 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:33.755282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] Creating event network-changed:9f7b31b0-6620-4723-98f0-bc0060df7aa2 for instance b83bb86e-3508-4057-a16d-d43f33bd56f2 on hv-cinder-85200 Aug 06 01:41:33.760599 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-55b7acf8-e141-4aca-9634-86a038defe02 req-802d4ce3-e4c0-45b1-b847-3920f35abfb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033839 Aug 06 01:41:33.761333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 467/957] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:41:40.315811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:40.316415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:40.322712 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:40.323193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:40.323626 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:40.324329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:40.324780 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:40.325239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:40.348189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-89e8a712-35b7-42d7-b062-9be291293887 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.037243 Aug 06 01:41:40.348744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 491/958] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Aug 6 01:41:40 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:41:43.310511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:41:43.311126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:43.317440 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:43.317929 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:43.318420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:43.319103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:43.319559 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:43.319984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:43.343102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lazy-loading 'flavor' on Instance uuid 170974cd-97c4-4012-a65c-aa0e341842b8 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:41:43.521898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b2801ae2-3315-4b8d-a3eb-7d0d5f810f43 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/action" status: 202 len: 0 microversion: 2.20 time: 0.216224 Aug 06 01:41:43.522506 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 468/959] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Aug 6 01:41:43 2022] POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:41:43.531340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:43.531940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:43.538693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:43.539190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:43.539633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:43.540329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:43.540880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:43.541281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:43.672427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:43.680356 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:43.682465 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:43.683624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-31c0d3aa-8929-4d80-8404-acd60f544dfe tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.156321 Aug 06 01:41:43.684185 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 492/960] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:43 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:44.708565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:44.709294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:44.717427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:44.717657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:44.718103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:44.718791 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:44.719244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:44.719671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:44.851625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:44.859992 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:44.861574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:44.863159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6c12f186-095b-4d26-a740-4e21f644b747 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.159001 Aug 06 01:41:44.863320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 469/961] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:44 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:45.886281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:45.886883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:45.893344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:45.893824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:45.894254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:45.894934 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:45.895383 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:45.895804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:46.030054 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:46.037995 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:46.039510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:46.041533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-900c8983-a86d-4f9a-9c90-a00f52c42830 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.158363 Aug 06 01:41:46.042108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 493/962] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:45 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:47.064666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:47.065325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:47.071313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:47.071801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:47.072332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:47.072918 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:47.073392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:47.073815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:47.201299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:47.209120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:47.210620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:47.211768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5e5f970f-96f8-4cbd-92a3-c1877703488f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.151260 Aug 06 01:41:47.212336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 470/963] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:47 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:48.233740 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:48.234354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:48.240717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:48.241232 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:48.241674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:48.242362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:48.242817 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:48.243243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:48.375816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:48.383823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:48.386162 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:48.387515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f8c858a2-6039-4d1f-9ed9-5f5aaf83f6c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.157727 Aug 06 01:41:48.388110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 494/964] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:48 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:49.410235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:49.410882 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:49.413328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:49.418590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:49.419080 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:49.419517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:49.420207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:49.420664 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:49.421124 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:49.549469 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:49.557403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:49.558919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:49.560085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2ebbc781-6001-4a4c-8c62-d45f768cbb55 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.153831 Aug 06 01:41:49.560649 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 471/965] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:49 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:41:50.583159 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:50.583763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:50.586246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=32 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:50.592496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:50.592975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:50.593441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:50.594121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:50.594588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:50.595214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:50.722206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:50.731143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:50.732635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:50.733892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-80fb71b3-f104-4ea6-a423-44ca4acdf91e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.154768 Aug 06 01:41:50.734447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 495/966] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:50 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:51.756999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:51.757631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:51.764014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:51.764495 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:51.768817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:51.768817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:51.768817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:51.768817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:51.899036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:51.908572 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:51.910101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:51.911389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d9fcac9f-2c2c-401e-bdef-be447bac8cc4 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.158303 Aug 06 01:41:51.912160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 472/967] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:51 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:52.933399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:52.934003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:52.940444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:52.940928 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:52.941393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:52.942084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:52.942539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:52.942965 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:53.071235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:53.079714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:53.081261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:53.082520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9f935df9-9b86-4320-90ad-a8107c237100 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.153069 Aug 06 01:41:53.083086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 496/968] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:52 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:54.106098 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:54.106711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:54.113234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:54.113719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:54.114154 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:54.114843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:54.115297 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:54.115722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:54.245758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:54.253494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:54.254988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:54.256133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-732b79b0-8d5f-4014-a280-a2b25cee1031 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.154228 Aug 06 01:41:54.256684 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 473/969] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:54 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:55.279413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:55.280015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:55.286327 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:55.286807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:55.287236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:55.287919 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:55.288366 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:55.288784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:55.417293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:55.419467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=65 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:55.426282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:55.427792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:55.428952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2954e4e1-7a1b-4147-89ed-a25b503f9fa1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.153509 Aug 06 01:41:55.429607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 497/970] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:55 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:41:56.452890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:56.453537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:56.459913 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:56.460388 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:56.460819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:56.461532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:56.461987 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:56.462435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:56.594178 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:56.596403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:56.604192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:56.605910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:56.607101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-14cd9563-42c0-41d7-b192-c2fd1faceaa3 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.158094 Aug 06 01:41:56.607655 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 474/971] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:56 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:57.630400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:57.631015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:57.637157 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:57.637646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:57.638083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:57.638766 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:57.639221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:57.639644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:57.765896 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:57.773717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:57.775493 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:57.776655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-49a1a485-82ae-43f7-a695-cb2afd1a211b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.150145 Aug 06 01:41:57.777247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 498/972] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:57 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:58.800631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:58.801273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:58.809277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:58.809759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:58.810190 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:58.810874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:58.811325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:58.811745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:58.939604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:58.948595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:58.950114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:41:58.951268 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e5f2b88e-76e2-4114-a31d-7d05cc1902d0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.154974 Aug 06 01:41:58.951823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 475/973] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:58 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:41:59.973815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:41:59.974456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:41:59.981332 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:59.981849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:59.982283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:41:59.982964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:41:59.983414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:41:59.983836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:00.114146 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:00.122611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:00.124170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:00.125364 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-48354409-bfc1-4581-aa69-d8eca88f7331 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.155481 Aug 06 01:42:00.125914 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 499/974] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:41:59 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:01.150274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:01.151130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:01.157282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:01.157750 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:01.158179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:01.158857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:01.159302 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:01.159737 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:01.289967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:01.298615 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:01.300117 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:01.301301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-213ae7f9-a904-4dd7-97c4-7171cd05940c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1742 microversion: 2.20 time: 0.155615 Aug 06 01:42:01.301859 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 476/975] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:01 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:02.323828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:02.324440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:02.331128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:02.331621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:02.332070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:02.332770 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:02.333266 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:02.333695 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:02.537239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:02.546503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:02.548193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:02.549433 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-7ca8ac2e-d7f0-4bec-818e-57c503409c22 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1742 microversion: 2.20 time: 0.229573 Aug 06 01:42:02.550009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 500/976] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:02 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1742 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:03.573815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:03.574351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:03.580631 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:03.581139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:03.581574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:03.582250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:03.582698 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:03.583115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:03.713242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:03.721088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:03.722581 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:03.723735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-398e1dd8-11b7-4efe-a190-bbe557d4820f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1742 microversion: 2.20 time: 0.154934 Aug 06 01:42:03.724286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 477/977] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:03 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:04.544788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "name": "network-vif-plugged", "status": "completed", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:04.555358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:04.557428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:04.557915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:04.569331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] Creating event network-vif-plugged:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:42:04.574828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-2daa8096-3f14-4b9b-944f-c236d06e38d8 req-67762fed-057b-4b94-9d66-f8eb5772f247 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034262 Aug 06 01:42:04.575362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 501/978] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:04.747648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:04.748315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:04.754879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:04.755364 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:04.755814 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:04.756491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:04.756945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:04.757403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:04.887249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:04.895090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:04.896591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:04.897793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5026c74e-4bff-42ad-8ecb-c698cbac01e7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1742 microversion: 2.20 time: 0.154526 Aug 06 01:42:04.898358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 478/979] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:04 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:05.922344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:05.923046 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:05.929697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:05.930183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:05.930621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:05.931942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:05.932555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:05.933006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:06.007385 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-332483680"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:06.008645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:06.016186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:06.016819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:06.017287 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:06.018001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:06.018468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:06.018901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:06.082563 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:06.091229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:06.092830 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:06.094023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-397351cf-be50-4549-a8e6-8dc19d4ada99 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1742 microversion: 2.20 time: 0.176028 Aug 06 01:42:06.094822 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 502/980] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:05 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:06.170335 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.network.security_group_api [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Removing security group 2b932084-aa7c-4170-a817-1c576692232d from port b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 Aug 06 01:42:06.479557 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-459f72cf-c871-4a7b-9183-5959d1ecc2c1 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action" status: 202 len: 0 microversion: 2.1 time: 0.476116 Aug 06 01:42:06.480172 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 479/981] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Aug 6 01:42:06 2022] POST /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 01:42:06.491123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:06.501553 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:06.502032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:06.502462 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:06.518305 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] Creating event network-changed:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:42:06.523754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-ee692dc5-d95d-4007-8d1a-29e97ed10daa req-3d1afca6-3d15-49df-849e-5774f15cdabf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036073 Aug 06 01:42:06.526643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 503/982] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:07.125928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:07.128365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:07.146531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:07.147308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:07.148012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:07.148727 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:07.153277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:07.154081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:07.372773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:07.391071 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:07.394065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:07.395516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-23df1195-1a2d-4587-9eb9-998a67944038 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.281410 Aug 06 01:42:07.413272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 480/983] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:07 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:08.028661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:08.029406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:08.050653 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.051151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.051588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.053328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:08.064427 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.064908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.065372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.069139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.070111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.070702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.093437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] Creating event network-changed:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:42:08.101389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-c005b843-0671-47f3-a629-0121638f9035 req-1e654c55-0003-4653-a1ff-fb61b31d50d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059098 Aug 06 01:42:08.107135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 481/984] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 06 01:42:08.208495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lazy-loading 'services' on Instance uuid f4f0548a-6678-4b16-a699-e5d295aaa13c {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:42:08.313338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-34778a9b-79a9-40ad-96ac-35e889f6f7bb tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments/d6719523-ebf4-43e6-a9c5-5d64468c0199" status: 202 len: 0 microversion: 2.1 time: 0.292209 Aug 06 01:42:08.324186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:08.340228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:08.345673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 504/985] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:42:08 2022] DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments/d6719523-ebf4-43e6-a9c5-5d64468c0199 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:42:08.358869 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.360525 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.362213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.363185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.365017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.366484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.410843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5d7e9510-febb-4ab1-9515-6f1b8f7c7167 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090784 Aug 06 01:42:08.417279 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 482/986] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:42:08 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:08.440435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:08.441342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:08.453247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.453754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.454193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.454893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:08.457317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:08.457951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:08.677360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:08.693833 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:08.697256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:08.699510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-75eb6871-afce-4be7-98b2-1b74e934e63b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.263409 Aug 06 01:42:08.700083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 505/987] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:08 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:09.429550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:09.433662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:09.441650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.442461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.443304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.444217 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.444890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.450089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.562888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-54f3ad1a-234f-47ef-9c5f-e8e510ee5856 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140781 Aug 06 01:42:09.563477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 483/988] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:42:09 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:42:09.582527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:09.583391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:09.597108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.598112 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.598751 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.599650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.600453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.601109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.692755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] HTTP exception thrown: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c is not attached to volume d6719523-ebf4-43e6-a9c5-5d64468c0199 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Request method failure captured: Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments/d6719523-ebf4-43e6-a9c5-5d64468c0199 HTTP/1.1 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cYezntjO2lHOP2d9KidC7nPXBUc5opb-bjNzK-rqkgVtgRmGGyhA6zk7lxxHbvUCagd33Jc3F8fUwOE83J7JueJR1O-Xt5TfhgFwNuRy7-cuz-jxM5zNwtMJQ7x3z2pKHJhs5RRv6zUWkl9JckKxBHyisTzlsre7spLV0SfGohkKFc Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 4db9537bd65748f6b43061f3530f6891 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:42:09.695412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4db9537bd65748f6b43061f3530f6891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4db9537bd65748f6b43061f3530f6891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4db9537bd65748f6b43061f3530f6891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4db9537bd65748f6b43061f3530f6891"}]}] Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 4db9537bd65748f6b43061f3530f6891 Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-TestMinimumBasicScenario-1747592933-project Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 5cb73f6047dd42aaba23072f51972e9f Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-TestMinimumBasicScenario-1747592933-project Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:42:09.697619 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c is not attached to volume d6719523-ebf4-43e6-a9c5-5d64468c0199 Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'server_id': 'f4f0548a-6678-4b16-a699-e5d295aaa13c', 'id': 'd6719523-ebf4-43e6-a9c5-5d64468c0199'} Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d6719523-ebf4-43e6-a9c5-5d64468c0199. Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:42:09.698545 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c is not attached to volume d6719523-ebf4-43e6-a9c5-5d64468c0199 Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c is not attached to volume d6719523-ebf4-43e6-a9c5-5d64468c0199 Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:42:09.700023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Returning 404 to user: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c is not attached to volume d6719523-ebf4-43e6-a9c5-5d64468c0199 {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:42:09.701239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4360751b-5783-4b5d-9c52-b80af222db56 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments/d6719523-ebf4-43e6-a9c5-5d64468c0199" status: 404 len: 154 microversion: 2.1 time: 0.124715 Aug 06 01:42:09.701239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 506/989] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:42:09 2022] DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c/os-volume_attachments/d6719523-ebf4-43e6-a9c5-5d64468c0199 => generated 154 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:42:09.727272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:09.727881 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:09.735546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.736053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.736489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.737560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:09.738351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:09.739328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:09.951794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:09.965943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:09.967988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:09.969521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7892806a-083f-45bb-9f7f-a125ca193007 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.245837 Aug 06 01:42:09.971173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 484/990] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:09 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:10.888607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:10.889822 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:10.896692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:10.897238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:10.897682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:10.898392 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:10.898864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:10.899301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:10.927142 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:42:11.003530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:11.004128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:11.015192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:11.015690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:11.026406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:11.027725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:11.028576 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:11.029290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-87b8ab99-2d7f-4c2d-ad69-46d7e7e4e8e7 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 204 len: 0 microversion: 2.1 time: 0.147334 Aug 06 01:42:11.029647 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:11.034183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 507/991] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:42:10 2022] DELETE /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:42:11.042503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:11.043490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:11.050102 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:11.050852 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:11.051477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:11.052346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:11.052969 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:11.053590 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:11.502887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:11.513777 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:11.514754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:11.515715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:11.518248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-75817e3c-af2a-4477-9bea-30c9eb7360f1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.519843 Aug 06 01:42:11.523541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-edf23372-975e-4da9-8a33-34ecd49191af tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1555 microversion: 2.1 time: 0.487522 Aug 06 01:42:11.524128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 508/992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:11 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:11.530072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 485/993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:10 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:12.545165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:12.545810 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:12.549384 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:12.549968 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:12.564048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:12.564552 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:12.565019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:12.565262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:12.566085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:12.567008 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:12.567465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:12.567891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:12.568505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:12.569256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:12.569921 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:12.573497 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:12.798719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:12.809330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1e6e62ac-d17c-4744-bdaa-3fb59cf4fb8a tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1555 microversion: 2.1 time: 0.268672 Aug 06 01:42:12.810554 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 486/994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:12 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:12.817910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:12.829837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:12.831446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:12.832702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-26d8d131-29b8-4c79-acd5-144769d128ea tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.294526 Aug 06 01:42:12.848209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 509/995] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:12 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:13.830824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:13.831453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:13.842516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0548a-6678-4b16-a699-e5d295aaa13c", "name": "network-vif-deleted", "tag": "b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:13.853988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:13.859032 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:13.859632 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:13.860144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:13.860928 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:13.861479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:13.861979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:13.862765 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:13.867244 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:13.892890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] Creating event network-vif-deleted:b1b7bbdf-fdb4-457d-a1c8-ffff3f44f783 for instance f4f0548a-6678-4b16-a699-e5d295aaa13c on hv-cinder-85200 Aug 06 01:42:13.902301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-e5774f33-0f89-4864-97b7-c5b62e823b21 req-2d6d34ba-bf2d-43c9-aa62-0102437e11f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063785 Aug 06 01:42:13.905393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 510/996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:42:13.919422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:13.920132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:13.929648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:13.930458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:13.932021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:13.933077 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:13.933623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:13.934121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:13.975375 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb73f6047dd42aaba23072f51972e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db9537bd65748f6b43061f3530f6891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:13.985240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-527227ac-11f9-4d72-a667-33596f3630dc tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 200 len: 1513 microversion: 2.1 time: 0.158130 Aug 06 01:42:13.986139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 487/997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:13 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:14.134498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:14.155743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:14.157294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:14.158489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f0abb755-bd89-48f6-a9ac-ad1f70f0a66f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.252020 Aug 06 01:42:14.159055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 511/998] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:13 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:15.007784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:15.009662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] [instance: f4f0548a-6678-4b16-a699-e5d295aaa13c] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:15.016603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:15.017338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:15.017773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:15.018654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:15.019270 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:15.019896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:15.035341 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] HTTP exception thrown: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Request method failure captured: Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c HTTP/1.1 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cYezntjO2lHOP2d9KidC7nPXBUc5opb-bjNzK-rqkgVtgRmGGyhA6zk7lxxHbvUCagd33Jc3F8fUwOE83J7JueJR1O-Xt5TfhgFwNuRy7-cuz-jxM5zNwtMJQ7x3z2pKHJhs5RRv6zUWkl9JckKxBHyisTzlsre7spLV0SfGohkKFc Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 4db9537bd65748f6b43061f3530f6891 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:42:15.037193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4db9537bd65748f6b43061f3530f6891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4db9537bd65748f6b43061f3530f6891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4db9537bd65748f6b43061f3530f6891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4db9537bd65748f6b43061f3530f6891"}]}] Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 4db9537bd65748f6b43061f3530f6891 Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747592933 Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestMinimumBasicScenario-1747592933-project Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 5cb73f6047dd42aaba23072f51972e9f Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestMinimumBasicScenario-1747592933-project Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. Aug 06 01:42:15.038801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'f4f0548a-6678-4b16-a699-e5d295aaa13c'} Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:42:15.039765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. Aug 06 01:42:15.041329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:15.043351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Returning 404 to user: Instance f4f0548a-6678-4b16-a699-e5d295aaa13c could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:42:15.043351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-79a97955-68f4-474d-bff5-fc19c665ed25 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c" status: 404 len: 111 microversion: 2.1 time: 0.034800 Aug 06 01:42:15.043351 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 488/999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:15 2022] GET /compute/v2.1/servers/f4f0548a-6678-4b16-a699-e5d295aaa13c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:42:15.048809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-579cd77b-4589-4415-a83a-f7c720a9f614 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] Calling method '.version_select at 0x7fbff7ee8820>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:15.070001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-579cd77b-4589-4415-a83a-f7c720a9f614 tempest-TestMinimumBasicScenario-1747592933 tempest-TestMinimumBasicScenario-1747592933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1077788567" status: 202 len: 0 microversion: 2.1 time: 0.024807 Aug 06 01:42:15.071390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 512/1000] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Aug 6 01:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1077788567 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:42:15.183287 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:15.184290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:15.193289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:15.194082 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:15.194745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:15.195791 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:15.196646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:15.198018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:15.360629 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:15.371094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:15.374003 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:15.375494 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1a319ad1-06a3-49ac-b80c-162bce04912e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.197183 Aug 06 01:42:15.376646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 489/1001] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:15 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:16.401748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:16.403129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:16.411554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:16.412060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:16.412500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:16.413268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:16.413803 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:16.414422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:16.577002 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:16.588927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:16.590737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:16.592104 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-74d5285d-eda4-4550-ae95-e26818a51a13 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.195282 Aug 06 01:42:16.593081 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 513/1002] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:16 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:17.621917 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:17.622560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:17.633283 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:17.634598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:17.635570 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:17.636508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:17.637166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:17.637763 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:17.903932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:17.912582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:17.914222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:17.915516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-aeeffd35-5c17-4455-b607-e5e9cc5e6561 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1737 microversion: 2.20 time: 0.299600 Aug 06 01:42:17.916261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 490/1003] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:17 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:18.132878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:18.133643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:18.134713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:18.152493 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.153000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.153474 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.154188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.156453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.157645 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.158059 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.158490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.162733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.175037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] Creating event network-changed:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:42:18.191482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-a447908a-1aca-4c5f-923a-009a39c4b90b req-0ac93202-3144-432f-a338-551a1bad7e20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062107 Aug 06 01:42:18.195073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 491/1004] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:18.206741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:42:18.222409 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:18.320943 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ec760a1e-919c-4326-99ef-749bb5d56a4c tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 204 len: 0 microversion: 2.1 time: 0.196031 Aug 06 01:42:18.323199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 514/1005] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:42:18 2022] DELETE /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:42:18.332691 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:18.333546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:18.340811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.341574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.342011 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.342701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.343360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.343951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.517774 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:18.526840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bb5a2c9a-a0f1-4d52-9f60-9afd45ba48ab tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.198608 Aug 06 01:42:18.527429 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 492/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:18 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:42:18.941015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:18.941826 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:18.956237 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.957427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.958104 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:18.959357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:18.960058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:18.960874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:19.158491 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:19.169756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:19.171949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:19.181339 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fc1a0b9f-a7f1-4d69-a4a5-d9cb13c3bbf0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1719 microversion: 2.20 time: 0.244065 Aug 06 01:42:19.182912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 515/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:18 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:19.548201 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:19.549775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:19.552296 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=44 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:19.558887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:19.559389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:19.559828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:19.560729 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:19.560998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:19.561415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:20.108617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:20.110924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=100 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:20.117606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9668989f-1198-4f64-862f-db840504fddb tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1567 microversion: 2.1 time: 0.573417 Aug 06 01:42:20.118176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 493/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:19 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1567 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:20.205285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:20.205889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:20.212781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:20.213301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:20.213736 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:20.214427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:20.214879 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:20.215297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:20.677722 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:20.686597 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:20.688325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:20.689522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a1e2d2f8-9bea-4b2c-b3bb-f396536d0b33 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1719 microversion: 2.20 time: 0.488244 Aug 06 01:42:20.690083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 516/1009] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:20 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1719 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:20.941213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90017aeb-8aa5-4956-984f-af411ab2a11b", "name": "network-vif-deleted", "tag": "bd1f9f0d-df47-4a28-92ad-46ec90e3d183"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:20.952425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:20.952983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:20.953518 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:20.966870 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] Creating event network-vif-deleted:bd1f9f0d-df47-4a28-92ad-46ec90e3d183 for instance 90017aeb-8aa5-4956-984f-af411ab2a11b on hv-cinder-85200 Aug 06 01:42:20.971952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-a4355c3e-a6af-4060-8bbd-f696ac6eff9a req-b1caae9d-27c1-411f-893a-68f87e0eedf2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Aug 06 01:42:20.972557 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 494/1010] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:21.139219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:21.139859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:21.141973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:21.147267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:21.147819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:21.148346 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:21.149149 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:21.150184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:21.150613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:21.271352 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:21.284115 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1b87a41c-dd17-49d5-9d64-becced43ed7f tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1218 microversion: 2.1 time: 0.148807 Aug 06 01:42:21.285354 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 517/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:21 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:21.713915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:21.714614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:21.721517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:21.722014 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:21.722453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:21.723215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:21.723719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:21.724254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:22.171107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:22.179058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:22.181485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:22.183327 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b30d1af5-d02c-4ae2-b0d7-23c36e164b91 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1719 microversion: 2.20 time: 0.474501 Aug 06 01:42:22.183935 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 495/1012] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:21 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:22.306937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:22.307610 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:22.313991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:22.314479 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:22.314917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:22.315635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:22.316097 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:22.316526 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:22.348691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:22.349210 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:22.349659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:22.350213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lazy-loading 'fault' on Instance uuid 90017aeb-8aa5-4956-984f-af411ab2a11b {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:42:22.423669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb2fa7d4e5b42388cb4a97ec3495d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722d0293c88d4711a7252d01bb91621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:22.432345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d0dd32ea-cf06-4111-b70c-5eea57dd679b tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 200 len: 1387 microversion: 2.1 time: 0.129992 Aug 06 01:42:22.433089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 518/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:22 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 1387 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:42:22.617356 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "name": "network-vif-unplugged", "status": "completed", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:22.632972 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:22.633442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:22.635064 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:22.654768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] Creating event network-vif-unplugged:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:42:22.660034 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-4e69c4d5-1d3a-4a50-a46c-4c2d4d286f33 req-81c21e43-07ab-45ca-ba22-617ef33abdb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046332 Aug 06 01:42:22.661184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 496/1014] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:23.207011 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:23.207628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:23.214361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:23.215059 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:23.215503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:23.216428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:23.216888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:23.217519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:23.454639 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:23.455556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] [instance: 90017aeb-8aa5-4956-984f-af411ab2a11b] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:23.460444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:23.462806 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:23.463706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:23.464365 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:23.465370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:23.466136 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:23.466775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:23.471488 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:23.473280 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:23.474478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0e62d93c-6f3b-4e89-b417-9386a24cfe4d tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1719 microversion: 2.20 time: 0.271585 Aug 06 01:42:23.475046 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 519/1015] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:23 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1719 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:23.482738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] HTTP exception thrown: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Request method failure captured: Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b HTTP/1.1 Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cUzxqX3Tq9GzNIZ_b4ZKfs1qZWWIFRvs1AYKyVfxUXhShM79dXS6cQjYCX56Yk4_v6zlzLH8_of8oePQ8eVFAopu8_5V1Mk-PybFfvqKSdu5CkzLNDC93rrmboYt5CK9l_6S0nWZdeJPnVqW3NWn9FEx829oUNoJGcn2KQDTSz1yrQ Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 722d0293c88d4711a7252d01bb91621d Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestShelveInstance-214148625 Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:42:23.484392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/722d0293c88d4711a7252d01bb91621d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/722d0293c88d4711a7252d01bb91621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_722d0293c88d4711a7252d01bb91621d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/722d0293c88d4711a7252d01bb91621d"}]}] Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestShelveInstance-214148625 Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 722d0293c88d4711a7252d01bb91621d Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestShelveInstance-214148625 Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestShelveInstance-214148625-project Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: cbb2fa7d4e5b42388cb4a97ec3495d51 Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestShelveInstance-214148625-project Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. Aug 06 01:42:23.486062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '90017aeb-8aa5-4956-984f-af411ab2a11b'} Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:42:23.486979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. Aug 06 01:42:23.488661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:42:23.489854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Returning 404 to user: Instance 90017aeb-8aa5-4956-984f-af411ab2a11b could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:42:23.489854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5fd79263-42b1-4790-a331-c15b62429745 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b" status: 404 len: 111 microversion: 2.1 time: 0.035586 Aug 06 01:42:23.489854 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 497/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:42:23 2022] GET /compute/v2.1/servers/90017aeb-8aa5-4956-984f-af411ab2a11b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:42:23.735684 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-092fee1e-98e6-4a7d-b1ce-643075c88186 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] Calling method '.version_select at 0x7fbfef787040>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:23.782074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-092fee1e-98e6-4a7d-b1ce-643075c88186 tempest-TestShelveInstance-214148625 tempest-TestShelveInstance-214148625-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-822945805" status: 202 len: 0 microversion: 2.1 time: 0.049964 Aug 06 01:42:23.784083 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 520/1017] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Aug 6 01:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-822945805 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:42:24.499414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:24.500045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:24.507251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:24.508297 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:24.508865 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:24.510876 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:24.511402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:24.512174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:24.736743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:24.745366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:24.746901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:24.748673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b45df626-5bd0-488b-ba82-26211686f7c1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1662 microversion: 2.20 time: 0.253926 Aug 06 01:42:24.749450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 498/1018] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:24 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:24.778678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "302777aa-0c02-4911-9807-1bd0beab2998"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:24.781009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:24.789203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:24.789782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:24.790406 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:24.791622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:24.792086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:24.792511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.160511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-98ec9a8b-5d0c-4d18-8307-ce0bfb97e4c7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.386880 Aug 06 01:42:25.166750 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 521/1019] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Aug 6 01:42:24 2022] POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 01:42:25.295855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:25.296674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:25.303614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.304221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.304636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.305376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.306873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.307313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.634654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-79b48c1b-efe8-416e-be68-06e60a450ef9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments/302777aa-0c02-4911-9807-1bd0beab2998" status: 202 len: 0 microversion: 2.20 time: 0.341802 Aug 06 01:42:25.638104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 499/1020] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Aug 6 01:42:25 2022] DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments/302777aa-0c02-4911-9807-1bd0beab2998 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:42:25.737754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:25.738762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:25.746871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.747466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.747974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.748764 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.749328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.749829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.788337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124313) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 01:42:25.866822 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-061506d3-4f8e-4081-872c-45c21ee4f98b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/action" status: 202 len: 0 microversion: 2.20 time: 0.132783 Aug 06 01:42:25.870323 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 522/1021] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Aug 6 01:42:25 2022] POST /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 01:42:25.878090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:25.878709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:25.885502 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.886018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.886486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:25.887164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:25.887824 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:25.888292 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:26.054801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:26.064898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:26.066620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:26.067985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1dd8da61-19ff-4aad-bfda-be09e75355a7 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1670 microversion: 2.20 time: 0.193784 Aug 06 01:42:26.069120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 500/1022] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:25 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:27.100268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:27.100917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:27.107249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:27.107781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:27.108452 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:27.109204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:27.109693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:27.110128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:27.454135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:27.462413 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:27.464095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:27.465434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f513c994-b63f-46ab-bd9d-36a79fdb7d06 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.373479 Aug 06 01:42:27.466371 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 523/1023] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:27 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:28.491017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:28.492476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:28.499149 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:28.499813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:28.500421 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:28.501143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:28.501781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:28.502423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:28.677919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:28.687359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:28.688889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:28.690130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fcfc8430-206b-43fe-be7d-253b0e525ecb tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.203375 Aug 06 01:42:28.717443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 501/1024] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:28 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:29.713596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:29.714820 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:29.725225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:29.729727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:29.730498 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:29.731458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:29.732368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:29.733241 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:29.950255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:29.960031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:29.962457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:29.964047 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-15c98112-b062-42b7-85a4-077bc391429a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.256003 Aug 06 01:42:29.965109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 524/1025] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:29 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:30.992208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:30.993965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:31.001867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:31.002731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:31.003342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:31.004300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:31.004794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:31.005251 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:31.237717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:31.256454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:31.258108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:31.261467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bee6a78b-acb9-4362-8c91-4f83ca6c0c71 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.273967 Aug 06 01:42:31.262349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 502/1026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:30 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:32.290566 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:32.292358 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:32.300018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:32.300828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:32.301468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:32.302373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:32.302999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:32.303580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:32.507468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:32.516589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:32.518480 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:32.519899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-872f3804-f5e3-43c4-b939-dd78c5610a21 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.239354 Aug 06 01:42:32.521003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 525/1027] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:32 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:33.543072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:33.543755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:33.550333 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:33.550817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:33.551248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:33.551965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:33.552414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:33.552838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:33.713269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:33.721368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:33.722875 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:33.724036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-444ba1e2-5829-447a-9de6-c59012c6eae1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.185101 Aug 06 01:42:33.724596 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 503/1028] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:33 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:34.747276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:34.747937 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:34.754963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:34.755538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:34.756227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:34.757009 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:34.757753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:34.758207 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:34.911020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:34.919900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:34.921449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:34.922866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8fddfe97-6ae7-4697-9016-b3204e9d4cb5 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.179895 Aug 06 01:42:34.923429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 526/1029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:34 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:35.945921 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:35.947097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:35.953739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:35.954229 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:35.954668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:35.955361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:35.955821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:35.956250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:36.100455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:36.108709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:36.110265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:36.111435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3542c088-5657-4456-9b4d-cd0b72dcbf23 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.169448 Aug 06 01:42:36.112034 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 504/1030] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:35 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:37.136828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:37.137586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:37.144261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:37.144756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:37.145222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:37.145924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:37.146381 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:37.146814 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:37.149484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:37.285001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:37.293611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:37.295093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:37.296270 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2e98ceaf-b5bf-454e-b6ee-361467341be8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.164370 Aug 06 01:42:37.296838 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 527/1031] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:37 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:38.319617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:38.320170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:38.326592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:38.327077 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:38.327514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:38.328202 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:38.328662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:38.329113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:38.460846 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:38.469258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:38.470767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:38.471923 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2467a0fe-cfe3-4c35-8856-ad4f00ff50be tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.156268 Aug 06 01:42:38.472480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 505/1032] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:38 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:39.497393 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:39.498137 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:39.505448 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:39.505936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:39.506374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:39.507063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:39.507520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:39.507952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:39.636147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:39.644290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:39.645876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:39.647063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-65db840d-34a0-4a36-8038-bf24c1cc302f tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.155085 Aug 06 01:42:39.647565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 528/1033] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:39 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:40.670344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:40.670871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:40.677312 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:40.677798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:40.678233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:40.678915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:40.679366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:40.679789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:40.809648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:40.817623 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:40.819135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:40.820282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7bde65c6-c86e-47ed-ba9c-c567e1573b48 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.153991 Aug 06 01:42:40.820868 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 506/1034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:40 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:41.844063 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:41.844673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:41.851222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:41.851701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:41.852189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:41.853133 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:41.853589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:41.854016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:41.984049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:41.991894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:41.993524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:41.994939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b00c5c70-78a9-4fd3-8206-73fce95a1270 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.154588 Aug 06 01:42:41.995506 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 529/1035] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:41 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:43.018110 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:43.018742 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:43.025991 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:43.026472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:43.026905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:43.027590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:43.028043 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:43.028464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:43.182980 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:43.192352 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:43.193900 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:43.195314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2b59ff24-1c38-411f-a5c5-66eb15f3530a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.180887 Aug 06 01:42:43.196256 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 507/1036] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:43 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:44.220184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:44.220790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:44.227959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:44.228434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:44.228865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:44.229589 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:44.230042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:44.230464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:44.559854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:44.567654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:44.569174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:44.570326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0aea025c-f5e7-4656-9480-3d335ba7db6a tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.354102 Aug 06 01:42:44.570910 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 530/1037] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:44 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:45.593637 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:45.594248 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:45.600582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:45.601084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:45.601529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:45.602725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:45.603275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:45.603703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:45.788891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:45.797358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:45.798874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:45.800036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e120c36c-cc22-47e2-bedd-3652a6ad9198 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.210337 Aug 06 01:42:45.800603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 508/1038] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:45 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:46.757787 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "name": "network-vif-plugged", "status": "completed", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:46.769221 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:46.769711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:46.770795 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:46.782376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] Creating event network-vif-plugged:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:42:46.787535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-2c56708d-54ce-47aa-b748-e8a9f4bb3ff5 req-94fc826e-ba44-47b2-b4a5-42f9596d91f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Aug 06 01:42:46.788312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 531/1039] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:46.823971 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:46.824577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:46.831018 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:46.831740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:46.832175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:46.832863 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:46.833339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:46.833761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:46.973075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:46.976555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:46.982156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:46.983643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:46.984794 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-85182393-6268-428b-99b7-575dc76ca0c8 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.165734 Aug 06 01:42:46.985389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 509/1040] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:46 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:48.010815 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:48.011516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:48.018212 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:48.018699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:48.019136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:48.019828 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:48.020283 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:48.020711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:48.151069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:48.158908 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:48.160416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:48.161612 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0d17bdf7-f656-46b2-8880-c776a299e2fc tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.155146 Aug 06 01:42:48.162183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 532/1041] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:48 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:49.185775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:49.186517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:49.193456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:49.193943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:49.194380 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:49.195070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:49.195529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:49.196669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:49.331475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:49.340499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:49.342101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:49.343377 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-20f61262-6bd9-4943-8074-b84d6b320753 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1728 microversion: 2.20 time: 0.161490 Aug 06 01:42:49.344107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 510/1042] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:49 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:42:50.367262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:50.368573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:50.375218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:50.375707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:50.376147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:50.376842 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:50.377328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:50.377759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:50.504293 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:50.512459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:50.514015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:42:50.515188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4af60792-0c52-414c-9e7e-29c3a5130fa9 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1715 microversion: 2.20 time: 0.151894 Aug 06 01:42:50.515757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 533/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:42:50 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:42:56.582517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:42:56.583048 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:56.585484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=36 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:56.590952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:56.591444 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:56.591885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:56.592583 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:56.593071 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:56.593501 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:56.616339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e309b6fc-9273-4589-83f5-026651e6322d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/ips" status: 200 len: 146 microversion: 2.1 time: 0.037660 Aug 06 01:42:56.616915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 511/1044] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:42:56 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:42:57.939758 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5481725b-c202-4338-822a-cc126eeab606"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:42:57.942208 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:42:57.944484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:57.949912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:57.950402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:57.950841 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:57.951533 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:42:57.951991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:42:57.952421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:42:58.209662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-666a3f0a-ae2e-4012-b871-0207493adeac tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273619 Aug 06 01:42:58.210296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 534/1045] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:42:57 2022] POST /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:05.730787 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:05.733040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:05.739556 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:05.740040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:05.740476 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:05.741281 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:05.741740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:05.742168 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:05.771601 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-86ef1f52-1a15-4103-8c73-12518d75c3db tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Aug 06 01:43:05.772210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 512/1046] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:43:05 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:05.784329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:05.784907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:05.791061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:05.791557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:05.792096 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:05.792783 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:05.793296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:05.793724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:05.821267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fff6d428-19da-42b8-9239-8d4ef5178721 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606" status: 200 len: 194 microversion: 2.1 time: 0.041662 Aug 06 01:43:05.821840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 535/1047] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Aug 6 01:43:05 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:07.147309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a81321fa-01d4-4d07-bb5b-0294f65f749b"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:07.149716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:07.158260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:07.158747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:07.159177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:07.159859 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:07.160313 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:07.160733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:07.433316 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-115d50c9-b334-469f-94f4-79b182097301 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "POST /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288978 Aug 06 01:43:07.433934 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 513/1048] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:43:07 2022] POST /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:07.575731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:07.576256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:07.582904 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:07.583395 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:07.583831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:07.584532 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:07.584992 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:07.585449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:07.589711 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:07.613515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-62cdabc1-4008-4156-aa13-057ba45ab33f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.041674 Aug 06 01:43:07.614054 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 536/1049] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:43:07 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:08.987545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6bfcc06-baad-4f72-b2bf-b3536d247442"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:08.990053 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:08.997403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:08.997896 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:08.998338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:08.999045 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:08.999503 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:08.999961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:09.286240 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2adcec42-31f4-4924-ab23-2cfc6050625c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303384 Aug 06 01:43:09.286878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 514/1050] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:43:08 2022] POST /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:14.964392 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:14.966671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:14.973237 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:14.973720 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:14.974150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:14.974831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:14.975284 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:14.975710 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:15.004984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8d0e1ee5-518e-488d-b5a5-5e2779bad81d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044831 Aug 06 01:43:15.005570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 537/1051] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:43:14 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:15.148331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:15.148880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:15.155236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:15.155723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:15.156192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:15.156890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:15.157376 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:15.157807 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:15.188320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b13dc2ca-e899-4738-af7e-5828ca323129 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606" status: 200 len: 194 microversion: 2.1 time: 0.045001 Aug 06 01:43:15.188919 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 515/1052] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Aug 6 01:43:15 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:15.200091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:15.200607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:15.206617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:15.207101 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:15.207535 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:15.208219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:15.208674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:15.209130 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:15.291402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.objects.instance [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lazy-loading 'services' on Instance uuid 8e863f95-ad5e-490d-8473-00f2ed18de58 {{(pid=124313) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:43:15.363390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ffa211c3-88f6-456f-b354-9649df9e353d tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606" status: 202 len: 0 microversion: 2.1 time: 0.167650 Aug 06 01:43:15.364087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 538/1053] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:43:15 2022] DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/5481725b-c202-4338-822a-cc126eeab606 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:43:22.081380 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-faa58fc2-4722-4d84-9c26-260282d31189 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: .version_select at 0x7fbff4342c10>, body: {"keypair": {"name": "tempest-keypair-631962672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFn2banIn6oFcuuR+lsT1TjCZDHm1tGBJf9og4K2/5AoisgTA/9/UeQ/PG31rha8TkIYDUCJupL9WFaiM993FRun/JwofmRsbUiLpA6nXIAVfSC3V6lrhMEOihUNR8QQA=="}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:22.096893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-faa58fc2-4722-4d84-9c26-260282d31189 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:43:22.100608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-faa58fc2-4722-4d84-9c26-260282d31189 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:43:22.122767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-faa58fc2-4722-4d84-9c26-260282d31189 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045148 Aug 06 01:43:22.123357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 516/1054] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:43:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:22.825453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:22.826035 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:22.832058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:22.832542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:22.832978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:22.833694 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:22.834151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:22.834578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:22.864649 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-53f727b9-4bcb-4391-8567-46373d70c6cc tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/a81321fa-01d4-4d07-bb5b-0294f65f749b" status: 200 len: 194 microversion: 2.1 time: 0.043999 Aug 06 01:43:22.865277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 539/1055] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Aug 6 01:43:22 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/a81321fa-01d4-4d07-bb5b-0294f65f749b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:22.877407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:22.877922 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:22.884470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:22.884994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:22.885480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:22.886186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:22.887160 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:22.887596 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:22.892119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:22.983669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lazy-loading 'services' on Instance uuid 8e863f95-ad5e-490d-8473-00f2ed18de58 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:43:23.060625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-340ff5a1-a638-4d66-8d3f-2d1523db6c5a tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/a81321fa-01d4-4d07-bb5b-0294f65f749b" status: 202 len: 0 microversion: 2.1 time: 0.187438 Aug 06 01:43:23.061300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 517/1056] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:43:22 2022] DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments/a81321fa-01d4-4d07-bb5b-0294f65f749b => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:43:23.424091 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-463662858", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "298c8e04-2f72-4e6a-a959-fe6b3ec17737"}], "security_groups": [{"name": "tempest-securitygroup--2121967826"}], "key_name": "tempest-keypair-631962672", "user_data": "}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:23.526891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] validate_networks() for [('298c8e04-2f72-4e6a-a959-fe6b3ec17737', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:43:24.195115 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:43:24.195691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:43:24.195989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:43:24.196396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:43:24.196801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:43:24.206013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.206489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.206920 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.207637 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.208087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.208508 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.225953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:43:24.229929 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:43:24.235437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:24.237855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:24.241317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:43:24.243559 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:43:24.243917 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.244403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.244838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.245819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.246618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.247057 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.278082 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-af90e89f-7893-4dc6-b91f-34c68fc9e0f5 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046575 Aug 06 01:43:24.278911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 518/1057] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:43:24 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 01:43:24.298158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1db50ed0-99e2-498d-9c7a-1de4d717dd00 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.878319 Aug 06 01:43:24.304622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 540/1058] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:43:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:43:24.311272 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-eddb8e65-af9d-45ca-9777-3e32852e4f06 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:24.312254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-eddb8e65-af9d-45ca-9777-3e32852e4f06 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:24.372590 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-eddb8e65-af9d-45ca-9777-3e32852e4f06 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:24.379998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-eddb8e65-af9d-45ca-9777-3e32852e4f06 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1240 microversion: 2.1 time: 0.073930 Aug 06 01:43:24.380651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 519/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:24 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:24.403759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:24.406307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:24.413669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.414162 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.414603 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.415312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.415775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.416205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.445859 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-051ed5e9-5d07-4e47-a4f8-e5fe63eea1a1 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046350 Aug 06 01:43:24.446444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 541/1060] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:43:24 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:43:24.509263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:24.509762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:24.515936 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.516424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.516853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.517743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.518387 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.518817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.545593 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:43:24.628906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fa09a988-965b-4db0-b4b8-efe0cc50367c tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 204 len: 0 microversion: 2.1 time: 0.122515 Aug 06 01:43:24.629786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 520/1061] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:43:24 2022] DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:43:24.641238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:24.642344 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:24.648960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.656443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.656949 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.657704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:24.658167 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:24.658595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:24.804912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:24.813599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-433a01f3-ad99-4a83-b9e5-fa917a6290f0 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1675 microversion: 2.1 time: 0.179488 Aug 06 01:43:24.814174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 542/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:24 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:43:25.401643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:25.402855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:25.409329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:25.409819 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:25.410254 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:25.410950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:25.411413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:25.411838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:25.473134 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:25.481208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-64d02313-0349-4e34-974d-f8dabfd965e6 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1244 microversion: 2.1 time: 0.083902 Aug 06 01:43:25.481830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 521/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:25 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:25.835342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:25.835962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:25.843098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:25.843583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:25.844024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:25.844713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:25.845209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:25.845641 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:25.972587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:25.980107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c99a87d9-853a-4047-99b3-48a4cadb282b tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1675 microversion: 2.1 time: 0.148612 Aug 06 01:43:25.980683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 543/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:25 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:26.501006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:26.501654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:26.507895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:26.508371 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:26.508802 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:26.509527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:26.509981 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:26.510400 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:26.574842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:26.582159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5ed32f82-f7a2-4921-96e6-30e16463f149 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1292 microversion: 2.1 time: 0.085087 Aug 06 01:43:26.582724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 522/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:26 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:27.002038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:27.003504 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:27.011823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:27.012317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:27.012982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:27.013727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:27.014187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:27.014614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:27.357180 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:27.365082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8359b0e9-5fd1-434d-8be5-01d5e5bbf4ba tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1675 microversion: 2.1 time: 0.366897 Aug 06 01:43:27.365663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 544/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:26 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1675 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:27.603349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:27.603969 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:27.607397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:27.619983 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:27.622477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:27.623215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:27.623789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:27.624311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:27.624748 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:27.705820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:27.713662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1529f1b4-9e05-49d8-bfc2-fbb2dd55d901 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1298 microversion: 2.1 time: 0.114195 Aug 06 01:43:27.715033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 523/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:27 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:28.314013 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e863f95-ad5e-490d-8473-00f2ed18de58", "name": "network-vif-deleted", "tag": "2b2d0a1e-e59a-4c90-9b26-15dbaed691f5"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:28.324679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:28.334281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:28.335010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:28.335628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:28.359103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] Creating event network-vif-deleted:2b2d0a1e-e59a-4c90-9b26-15dbaed691f5 for instance 8e863f95-ad5e-490d-8473-00f2ed18de58 on hv-cinder-85200 Aug 06 01:43:28.364866 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-455f4049-30cb-47ad-a18d-53aa95fc43f6 req-74083ab3-7104-4e18-a717-b9b88676f5e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054711 Aug 06 01:43:28.370010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 545/1068] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:28.387174 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:28.388060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:28.396103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:28.396849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:28.397878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:28.399739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:28.400378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:28.400988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:28.513716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ea8abba547669fe22d2065a726c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd83104ff2241519bcdd4e232eb6895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:28.522555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-262b894b-2727-4a1e-871d-5afd77e81771 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 200 len: 1323 microversion: 2.1 time: 0.139655 Aug 06 01:43:28.523159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 524/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:28 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 1323 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:28.736151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:28.736959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:28.743979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:28.744549 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:28.745084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:28.746118 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:28.746837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:28.747636 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:28.973595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:28.990355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-695ef957-f706-4b6b-a08e-018f6f55bbb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.258528 Aug 06 01:43:28.991107 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 546/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:28 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:43:29.543282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:29.544000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:29.550458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:29.551040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:29.551584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:29.552389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:29.552944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:29.553530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:29.567321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 HTTP/1.1 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:29.569151 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:29.570701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8e863f95-ad5e-490d-8473-00f2ed18de58'} Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:29.571690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:29.573169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:29.574945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:29.574945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-837a92fb-4fe8-43e9-9cba-8533e177587f tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 404 len: 111 microversion: 2.1 time: 0.032711 Aug 06 01:43:29.574945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 525/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:29 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:43:29.581586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-47727cdf-9d88-48a4-bdb6-4254a737bdd9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '.version_select at 0x7fbff4397c10>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:29.600608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-47727cdf-9d88-48a4-bdb6-4254a737bdd9 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022976735" status: 202 len: 0 microversion: 2.1 time: 0.022689 Aug 06 01:43:29.601129 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 547/1072] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Aug 6 01:43:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022976735 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:43:30.012816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:30.013456 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:30.019233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:30.019715 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:30.020357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:30.021255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:30.021878 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:30.022304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:30.249411 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:30.256815 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f8d599c7-6ee0-4390-85ac-ecd838d68e8c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.248447 Aug 06 01:43:30.257409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 526/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:30 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:30.394500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d42c75-08f4-4f77-860f-77c6adc4e82e", "tag": "d995a3a6-f7c1-4520-b852-99c2915559c4"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:30.405100 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:30.405585 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:30.406016 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:30.416360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] Creating event network-changed:d995a3a6-f7c1-4520-b852-99c2915559c4 for instance d3d42c75-08f4-4f77-860f-77c6adc4e82e on hv-cinder-85200 Aug 06 01:43:30.421303 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-a38ef91a-7f2f-4f73-9b7f-ea4ae38366b7 req-f591d485-5241-47b4-85c1-48e50ffc8475 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030759 Aug 06 01:43:30.421892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 548/1074] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:31.276642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:31.277453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:31.283833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:31.284320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:31.284758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:31.285482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:31.285938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:31.286366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:31.420606 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:31.428772 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8709bc15-82c1-4ead-9e23-5cc4eaa9457e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.155950 Aug 06 01:43:31.429638 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 527/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:31 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:32.452461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:32.453211 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:32.459999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.460689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.461110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.461836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.462306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.462751 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.562301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:32.563397 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:32.570823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.571562 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.572143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.573453 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.574871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.575620 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.591924 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 HTTP/1.1 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:32.593837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.595322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8e863f95-ad5e-490d-8473-00f2ed18de58'} Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:32.596222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.597611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.598989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:32.598989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a3d8c2b0-b5ff-486f-8ec4-126f67961acf tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 404 len: 111 microversion: 2.1 time: 0.037307 Aug 06 01:43:32.598989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 528/1076] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:43:32 2022] DELETE /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:43:32.605890 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:32.606605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: 8e863f95-ad5e-490d-8473-00f2ed18de58] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:32.613989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.614617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.615233 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.616087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:32.616700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:32.617318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:32.633017 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 HTTP/1.1 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:32.634871 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.636948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '8e863f95-ad5e-490d-8473-00f2ed18de58'} Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:32.637866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. Aug 06 01:43:32.639089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:32.640187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance 8e863f95-ad5e-490d-8473-00f2ed18de58 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:32.640187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-81578395-b80b-4705-9e58-23a61e7e1077 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58" status: 404 len: 111 microversion: 2.1 time: 0.037243 Aug 06 01:43:32.640187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 529/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:32 2022] GET /compute/v2.1/servers/8e863f95-ad5e-490d-8473-00f2ed18de58 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:43:32.665398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:32.673424 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d9f9fc1f-cd2c-43a2-940b-7bf4a5d1d871 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.226151 Aug 06 01:43:32.673991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 549/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:32 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:33.695648 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:33.696471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:33.703856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.704344 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.704782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.705501 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.705960 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.706395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.780973 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:33.781555 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:33.787941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.788428 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.788868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.789599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.790057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.790486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.804486 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac HTTP/1.1 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:43:33.806262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.807799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd25b0066-5e40-474a-94a9-d350a71af0ac'} Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:33.808935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.810519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.812915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:33.812915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fb0f541b-9fe2-4143-a09e-0a3c2ea9e496 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 404 len: 111 microversion: 2.1 time: 0.031109 Aug 06 01:43:33.812915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 550/1079] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:43:33 2022] DELETE /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:43:33.815974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:33.816583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] [instance: d25b0066-5e40-474a-94a9-d350a71af0ac] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:33.822353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.822837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.823274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.824565 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:33.824993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:33.825445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:33.837530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:33.841701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] HTTP exception thrown: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Request method failure captured: Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac HTTP/1.1 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTJlKmtgdBOGv9Gx9UPuBVlItnC2e6ahzTvKaCvVlBIDKyBSNbiLn0WvZKTRpyYKOPnTEdXfh_RI9CoOP98X_CucPaBMTInCfApU-u-QnKhYJcF6OvXAroJyLNzowGJS2Q78jqheqO7q8OdfxbukuMaXBkeppCespNoYopx7gZba6w Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:43:33.843236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4bd83104ff2241519bcdd4e232eb6895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4bd83104ff2241519bcdd4e232eb6895"}]}] Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 4bd83104ff2241519bcdd4e232eb6895 Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494771895 Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 2455ea8abba547669fe22d2065a726c6 Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeTestJSON-494771895-project Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.844640 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd25b0066-5e40-474a-94a9-d350a71af0ac'} Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:33.845418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. Aug 06 01:43:33.846621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:33.847837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] Returning 404 to user: Instance d25b0066-5e40-474a-94a9-d350a71af0ac could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:33.847837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cfe73e02-1c70-4717-834b-9f5ac1520232 tempest-AttachVolumeTestJSON-494771895 tempest-AttachVolumeTestJSON-494771895-project] 10.222.0.26 "GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac" status: 404 len: 111 microversion: 2.1 time: 0.032398 Aug 06 01:43:33.848008 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-26541a26-09f9-4f19-a7b7-e85680137d17 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.154583 Aug 06 01:43:33.848008 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 530/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:33 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:33.848665 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 551/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:33 2022] GET /compute/v2.1/servers/d25b0066-5e40-474a-94a9-d350a71af0ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:43:34.868467 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:34.869135 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:34.871708 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:34.879537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:34.880043 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:34.881330 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:34.883540 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:34.884189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:34.885265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:35.054312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d42c75-08f4-4f77-860f-77c6adc4e82e", "name": "network-vif-plugged", "status": "completed", "tag": "d995a3a6-f7c1-4520-b852-99c2915559c4"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:35.061543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:35.062222 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:35.068423 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:35.069187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:35.069617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:35.082858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] Creating event network-vif-plugged:d995a3a6-f7c1-4520-b852-99c2915559c4 for instance d3d42c75-08f4-4f77-860f-77c6adc4e82e on hv-cinder-85200 Aug 06 01:43:35.088634 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-a6ab8f76-c4f1-4576-93f3-d79779af552b req-1babfe2e-3cb2-47c9-9315-a10f6805c895 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038185 Aug 06 01:43:35.090404 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 552/1082] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:43:35.132680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:35.141536 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-79fb200e-d266-403e-861f-59c2f999e891 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.277761 Aug 06 01:43:35.142109 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 531/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:34 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:36.163337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:36.164060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:36.171238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:36.171744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:36.172187 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:36.172889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:36.173730 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:36.174188 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:36.318905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:36.328342 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-01dade62-5baa-4740-9ab8-1e8db69212c1 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1366 microversion: 2.1 time: 0.170326 Aug 06 01:43:36.328935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 553/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:36 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:37.348246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:37.348886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:37.355849 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:37.356331 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:37.356768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:37.357495 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:37.357944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:37.358366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:37.492912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:37.501703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-81f4339e-7334-425d-9234-1cd0977fbf2f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1554 microversion: 2.1 time: 0.157293 Aug 06 01:43:37.502271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 532/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:43:37 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:43:37.521654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:37.522158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:37.529990 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:37.530414 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:37.530858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:37.531564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:37.532030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:37.532464 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:37.643551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3e62c072-61de-48a1-b840-40ce06f5584d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121432 Aug 06 01:43:37.644704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 554/1086] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:43:37 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:38.637328 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d42c75-08f4-4f77-860f-77c6adc4e82e", "tag": "d995a3a6-f7c1-4520-b852-99c2915559c4"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:38.648749 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:38.649271 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:38.649724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:38.662307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] Creating event network-changed:d995a3a6-f7c1-4520-b852-99c2915559c4 for instance d3d42c75-08f4-4f77-860f-77c6adc4e82e on hv-cinder-85200 Aug 06 01:43:38.668247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-4efad289-356c-43d5-9265-6e48cbc45f30 req-60a5464b-ed77-4f53-8500-711c3cec2119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035057 Aug 06 01:43:38.668932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 533/1087] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:43:46.092611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:46.094868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:46.100926 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.101449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.101876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.102614 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.103014 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.103443 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.106029 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:46.133956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6b6e0cce-fe04-4f91-aa18-8e9496b38558 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046439 Aug 06 01:43:46.134807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 555/1088] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Aug 6 01:43:46 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:43:46.200901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:46.201626 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:46.208886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.209399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.209835 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.210522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.210979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.211405 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.238301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:43:46.254669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:46.320361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d99fd87a-1d46-4d5e-ade6-62653a1dc1a0 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 204 len: 0 microversion: 2.20 time: 0.124397 Aug 06 01:43:46.321088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 534/1089] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Aug 6 01:43:46 2022] DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 01:43:46.330391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:46.331006 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:46.337007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.337527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.337971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.338661 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:46.339122 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:46.339551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:46.468622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:46.476457 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:46.478000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:46.479150 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fe42e1f2-d3eb-4e71-861c-18e737e21fc1 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.152886 Aug 06 01:43:46.479704 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 556/1090] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:46 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:43:47.502813 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:47.503514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:47.509560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:47.510026 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:47.510473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:47.511180 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:47.511636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:47.512087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:47.646965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:47.655488 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:47.656998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:47.658189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-7f2bca50-f91c-4370-88bf-58d9282744de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.159698 Aug 06 01:43:47.658753 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 535/1091] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:47 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:43:48.680926 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:48.681547 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:48.688098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:48.688575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:48.689010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:48.689727 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:48.690183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:48.690613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:48.824459 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:48.832456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:48.833997 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:48.835161 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cfcb34f9-a286-4c6f-bd65-8812a37ef351 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.158260 Aug 06 01:43:48.835724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 557/1092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:48 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:43:49.858698 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:49.859402 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:49.865796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:49.866277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:49.866707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:49.867392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:49.867843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:49.868265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:49.999409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:50.007221 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:50.008858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:50.010036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9d163891-b935-4667-9427-5361913abf7b tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.155873 Aug 06 01:43:50.010597 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 536/1093] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:49 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:43:51.035082 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:51.035700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:51.041893 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:51.042415 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:51.043151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:51.044623 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:51.045141 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:51.045580 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:51.180336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:51.188932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:51.190532 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:51.192057 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6aa69b47-dd11-49c8-a814-472c4613a23e tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1721 microversion: 2.20 time: 0.161274 Aug 06 01:43:51.192811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 558/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:51 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 01:43:52.215020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:52.216137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:52.224421 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:52.224989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:52.225499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:52.226196 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:52.226646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:52.227096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:52.316386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:52.324265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:52.326604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ade772e11a4725928ab12d3bccc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16078c76f554419992faa7570fe5aba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:43:52.327952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bad97931-dce2-4ae2-bdab-69b0961bcabd tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 200 len: 1654 microversion: 2.20 time: 0.116704 Aug 06 01:43:52.328342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 537/1095] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:52 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 1654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 01:43:52.502275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170974cd-97c4-4012-a65c-aa0e341842b8", "name": "network-vif-deleted", "tag": "40917915-fb26-4c12-8d49-755ff9612959"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:43:52.513832 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:52.514319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:52.514757 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:52.526261 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] Creating event network-vif-deleted:40917915-fb26-4c12-8d49-755ff9612959 for instance 170974cd-97c4-4012-a65c-aa0e341842b8 on hv-cinder-85200 Aug 06 01:43:52.534837 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-2ffaaa1e-acd1-4b77-8f25-ad23e9f39d07 req-6925fc90-4d62-4891-bbaf-842268554b9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036071 Aug 06 01:43:52.539598 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 559/1096] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:43:53.350567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:53.351175 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:53.358529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:53.359181 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:53.359452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:53.360442 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:53.360908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:53.361426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:53.379138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 HTTP/1.1 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:53.380796 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:53.382353 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '170974cd-97c4-4012-a65c-aa0e341842b8'} Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:53.383176 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:53.384550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:53.386103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:53.386103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-479abf64-f0bc-4291-a3ea-6027945e7f39 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 404 len: 111 microversion: 2.20 time: 0.035578 Aug 06 01:43:53.386103 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 538/1097] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:53 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:43:53.392203 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-11bcf968-2d12-494c-b6e6-20fad4e0c5de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '.version_select at 0x7fbff43bcc10>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:53.413519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-11bcf968-2d12-494c-b6e6-20fad4e0c5de tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297107040" status: 204 len: 0 microversion: 2.20 time: 0.025807 Aug 06 01:43:53.414235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 560/1098] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Aug 6 01:43:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297107040 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 01:43:55.197122 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:55.198187 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:55.204743 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:55.205278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:55.205719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:55.206419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:55.206877 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:55.207307 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:55.223926 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 HTTP/1.1 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:55.225527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.227025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '170974cd-97c4-4012-a65c-aa0e341842b8'} Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:55.228099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.229372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.230721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:55.230721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-b2df4b94-c635-4d06-adbd-d3210b2a9b6c tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 404 len: 111 microversion: 2.20 time: 0.034028 Aug 06 01:43:55.230721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 539/1099] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Aug 6 01:43:55 2022] DELETE /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:43:55.236707 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:55.237494 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 170974cd-97c4-4012-a65c-aa0e341842b8] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:55.246044 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:55.246575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:55.247086 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:55.247784 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:55.248295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:55.248678 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:55.264476 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 HTTP/1.1 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:43:55.266583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.268285 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '170974cd-97c4-4012-a65c-aa0e341842b8'} Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:55.269767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. Aug 06 01:43:55.271278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:55.272790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 170974cd-97c4-4012-a65c-aa0e341842b8 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:55.272790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-40bdb369-9f48-4999-90c0-50e6906d1511 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8" status: 404 len: 111 microversion: 2.20 time: 0.035717 Aug 06 01:43:55.272790 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 561/1100] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:55 2022] GET /compute/v2.1/servers/170974cd-97c4-4012-a65c-aa0e341842b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:43:56.417663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:56.418128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:56.425238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:56.425724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:56.426165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:56.426855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:56.427314 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:56.427739 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:56.442380 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 HTTP/1.1 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:43:56.444129 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.445951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '4ed60127-a6a5-49bb-ace7-03495a61fcf2'} Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:56.446844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.448431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.450040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:56.450040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e2466759-3e73-43ae-975e-2f5f1a3d01f6 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 404 len: 111 microversion: 2.20 time: 0.031763 Aug 06 01:43:56.450040 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 540/1101] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Aug 6 01:43:56 2022] DELETE /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:43:56.455365 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:43:56.455985 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] [instance: 4ed60127-a6a5-49bb-ace7-03495a61fcf2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:43:56.462271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:56.462756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:56.463192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:56.463881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:43:56.464340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:43:56.464775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:43:56.478206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] HTTP exception thrown: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Request method failure captured: Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 HTTP/1.1 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7cTOeJJKO2TJjPUWV8XkQbYNeUyAxLtIRswr4u12vJAxqOuwCg-xsYx7xahuRzuSu-HoYhyt_HCTQk-U_FszFALU0kt_HkQ-pZlG3eIJamS8do10FJyB-caD1K9PaM1qFOZ32i63t3a5GSLjTnls5WLY37lTdBC7qC_LRMpcQHB-CV8 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:43:56.479779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16078c76f554419992faa7570fe5aba1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16078c76f554419992faa7570fe5aba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16078c76f554419992faa7570fe5aba1"}]}] Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 16078c76f554419992faa7570fe5aba1 Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708044309 Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 42ade772e11a4725928ab12d3bccc4a7 Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708044309-project Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.481444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '4ed60127-a6a5-49bb-ace7-03495a61fcf2'} Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:43:56.482940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. Aug 06 01:43:56.484685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:43:56.486069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] Returning 404 to user: Instance 4ed60127-a6a5-49bb-ace7-03495a61fcf2 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:43:56.486069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5c62251f-1c2d-46e9-af80-1d7419ecdb01 tempest-AttachVolumeShelveTestJSON-1708044309 tempest-AttachVolumeShelveTestJSON-1708044309-project] 10.222.0.26 "GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2" status: 404 len: 111 microversion: 2.20 time: 0.029735 Aug 06 01:43:56.486069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 562/1102] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Aug 6 01:43:56 2022] GET /compute/v2.1/servers/4ed60127-a6a5-49bb-ace7-03495a61fcf2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:44:45.510354 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:44:45.511079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:44:45.751450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e25d19a4-852a-4499-9c8f-2bd0bf109858 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Action: 'create', calling method: .version_select at 0x7fbff408f700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1895415522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzsAeu1cR98JcL84yR74g9F1e7wHSe/JAS1VwPgYpPVWQL5pb3c9Cic3mRWa82/2cW1jqjMdoKnziiKrbcAzrsd8Fon0XZygOEK1hpILZUDT8/HVblyeZ75+rRZlYFaDQ=="}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:44:45.770348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-e25d19a4-852a-4499-9c8f-2bd0bf109858 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:44:45.775082 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-e25d19a4-852a-4499-9c8f-2bd0bf109858 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for user 6ac05cb43bb146cbb0a548ff3148a77a and project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:44:45.816946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e25d19a4-852a-4499-9c8f-2bd0bf109858 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.311545 Aug 06 01:44:45.818119 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 541/1103] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:44:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:05.463596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:05.464336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=29 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:05.469246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:05.469770 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:05.476772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.477316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.477756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.478445 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.478898 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.479322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.502753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9890c598-b883-4926-8014-88d7c5176929 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/ips" status: 200 len: 148 microversion: 2.1 time: 0.040946 Aug 06 01:45:05.503317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 563/1104] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:45:05 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:05.511805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=4 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:05.512622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:05.517309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6bfcc06-baad-4f72-b2bf-b3536d247442"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:05.519695 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:05.527942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.528426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.529446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.530133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.530584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.531004 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.609232 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: POST /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/os-volume_attachments HTTP/1.1 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 74 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:45:05.610838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {"volumeAttachment": {"volumeId": "f6bfcc06-baad-4f72-b2bf-b3536d247442"}} Aug 06 01:45:05.612661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'server_id': 'd3d42c75-08f4-4f77-860f-77c6adc4e82e', 'body': {'volumeAttachment': {'volumeId': 'f6bfcc06-baad-4f72-b2bf-b3536d247442'}}} Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:45:05.613674 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:05.615265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 400 to user: Invalid volume: volume f6bfcc06-baad-4f72-b2bf-b3536d247442 is already attached to instances: b83bb86e-3508-4057-a16d-d43f33bd56f2 {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6e96b368-3ac1-4f34-ba3c-fc35070c0cf0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101825 Aug 06 01:45:05.616873 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 542/1105] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:45:05 2022] POST /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 01:45:05.622971 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:05.623466 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:05.629373 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.629860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.630297 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.630993 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.631447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.631875 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.656448 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:45:05.729076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0f8ae9ba-8a90-424b-80fa-e85c686a95e4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 204 len: 0 microversion: 2.1 time: 0.110129 Aug 06 01:45:05.729673 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 564/1106] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:45:05 2022] DELETE /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:45:05.740158 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:05.740759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:05.747745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.748235 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.748669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.749417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:05.749874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:05.750298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:05.878938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:05.886515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5ca04ff5-86bd-49f3-9dcd-4b5d28d28d3b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1679 microversion: 2.1 time: 0.150558 Aug 06 01:45:05.887084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 543/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:05 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:06.908611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:06.909274 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:06.915763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:06.916258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:06.916697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:06.917421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:06.917882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:06.918314 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:07.045836 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:07.053330 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d1319204-2551-448e-9987-5a20deab6e5b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1679 microversion: 2.1 time: 0.149133 Aug 06 01:45:07.053892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 565/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:06 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:08.075370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:08.076613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:08.083816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:08.084303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:08.084735 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:08.085451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:08.085932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:08.086386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:08.306783 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:08.314428 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f7e14be1-1fdf-4f50-a245-9d595ebb90b7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1679 microversion: 2.1 time: 0.244078 Aug 06 01:45:08.315083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 544/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:08 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:09.152045 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d42c75-08f4-4f77-860f-77c6adc4e82e", "name": "network-vif-deleted", "tag": "d995a3a6-f7c1-4520-b852-99c2915559c4"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:09.162767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:09.163245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:09.163676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:09.177476 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] Creating event network-vif-deleted:d995a3a6-f7c1-4520-b852-99c2915559c4 for instance d3d42c75-08f4-4f77-860f-77c6adc4e82e on hv-cinder-85200 Aug 06 01:45:09.185446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-03d41812-19ca-4900-bb1c-658ab71dea9e req-aad86e58-ca00-4b82-a8a2-3e6837610178 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246530 Aug 06 01:45:09.187124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 566/1110] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:09.336801 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:09.337461 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:09.343800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:09.344282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:09.344716 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:09.345426 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:09.345879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:09.346309 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:09.378997 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:09.379489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:09.379955 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:09.380433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'fault' on Instance uuid d3d42c75-08f4-4f77-860f-77c6adc4e82e {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:45:09.428789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:09.438864 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-66cf28bf-997d-41c0-8440-f980319017e9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 200 len: 1330 microversion: 2.1 time: 0.106592 Aug 06 01:45:09.439443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 545/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:09 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:10.459999 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:10.460691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:10.467434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:10.468098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:10.468538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:10.469312 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:10.469774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:10.470233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:10.483729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e HTTP/1.1 Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:45:10.485377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:45:10.486974 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd3d42c75-08f4-4f77-860f-77c6adc4e82e'} Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:45:10.487809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:45:10.489148 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:10.490793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:45:10.490793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-9e853bc9-b8b4-4c4c-a1b8-e03350834824 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 06 01:45:10.490793 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 567/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:10 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:45:10.495614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4c1aab24-de60-41ba-ac60-d2454d643550 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '.version_select at 0x7fbff4119550>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:10.515762 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4c1aab24-de60-41ba-ac60-d2454d643550 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631962672" status: 202 len: 0 microversion: 2.1 time: 0.023821 Aug 06 01:45:10.516342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 546/1113] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Aug 6 01:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631962672 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:45:10.705743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-537002025", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895415522", "security_groups": [{"name": "tempest-secgroup-smoke-1814580085"}], "block_device_mapping_v2": [{"uuid": "ea04d095-2a33-4ef9-92f7-f53fedf8448d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3bc265c-51c9-44de-a207-e5ab970830b8"}]}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:10.823935 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] validate_networks() for [('a3bc265c-51c9-44de-a207-e5ab970830b8', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:45:11.188874 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:11.189404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:11.195447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.195945 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.196383 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.197128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.197594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.198052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.207098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:45:11.207489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:45:11.208139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:45:11.208569 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:45:11.208980 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:45:11.219277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.219760 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.220195 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.220916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.221389 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.221813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.241310 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:45:11.245933 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for user 6ac05cb43bb146cbb0a548ff3148a77a and project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:45:11.296433 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'services' on Instance uuid b83bb86e-3508-4057-a16d-d43f33bd56f2 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:45:11.309763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:45:11.313177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea04d095-2a33-4ef9-92f7-f53fedf8448d',volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:45:11.386212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1940a762-e89c-426e-88cc-a3828f17fffb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments/f6bfcc06-baad-4f72-b2bf-b3536d247442" status: 202 len: 0 microversion: 2.1 time: 0.200161 Aug 06 01:45:11.387267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 547/1114] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:45:11 2022] DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments/f6bfcc06-baad-4f72-b2bf-b3536d247442 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 01:45:11.398414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:11.401378 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:11.413128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.415072 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.415640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.416366 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:11.417304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:11.417831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:11.455775 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-88fd35db-5988-402d-81a1-e29f8880ab76 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061511 Aug 06 01:45:11.456694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 548/1115] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:11 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:11.469622 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-83946a00-217b-42a3-a102-9ee8010f64f1 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767938 Aug 06 01:45:11.470733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 568/1116] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:45:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:45:11.482887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-74e75d8c-b6f1-46ae-8014-817e843502c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:11.484152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-74e75d8c-b6f1-46ae-8014-817e843502c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:11.558811 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-74e75d8c-b6f1-46ae-8014-817e843502c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:11.567159 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-74e75d8c-b6f1-46ae-8014-817e843502c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1094 microversion: 2.1 time: 0.088232 Aug 06 01:45:11.567752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 549/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:11 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:12.468453 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:12.470809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:12.477299 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:12.477781 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:12.478218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:12.478909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:12.479363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:12.479788 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:12.510561 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-13afd7ad-d605-4885-b41b-830eacd1b2df tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Aug 06 01:45:12.511109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 569/1118] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:12 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:12.593468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:12.594083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:12.601471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:12.601961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:12.602401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:12.603090 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:12.603551 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:12.603978 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:12.666867 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:12.674898 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a8731032-5050-43aa-8943-d923f8f9345e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1144 microversion: 2.1 time: 0.085909 Aug 06 01:45:12.675468 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 550/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:12 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:13.522407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:13.524557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:13.531585 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:13.532076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:13.532510 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:13.533245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:13.533708 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:13.534139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:13.562771 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0ed63399-501d-499f-89b3-3a5cf82c6b20 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 06 01:45:13.563538 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 570/1120] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:13 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:13.694381 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:13.694988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:13.701299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:13.701781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:13.702925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:13.703767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:13.704220 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:13.704644 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:13.766809 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:13.774120 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e1c22725-0460-4765-b787-2ace1b67b765 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1144 microversion: 2.1 time: 0.083616 Aug 06 01:45:13.774683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 551/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:13 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:14.574827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:14.576991 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:14.583361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:14.583845 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:14.584281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:14.584967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:14.585447 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:14.585871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:14.615099 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3e8b8ad1-207a-46d9-8b52-211b836a40ee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Aug 06 01:45:14.615641 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 571/1122] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:14 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:14.795450 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:14.796133 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:14.803070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:14.803548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:14.803979 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:14.804665 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:14.805126 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:14.805547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:14.864931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:14.872424 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0cb9f3e3-4ef8-4596-90e3-92e3dec3661f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1144 microversion: 2.1 time: 0.080861 Aug 06 01:45:14.872984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 552/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:14 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:15.627749 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:15.629917 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:15.636251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:15.636734 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:15.637196 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:15.637878 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:15.638325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:15.638745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:15.668074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2144de09-497e-4547-b05f-8e3e8015eb7f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 06 01:45:15.668557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 572/1124] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:15 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:15.893475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:15.894087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:15.900541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:15.901022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:15.901486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:15.902169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:15.902625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:15.903050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:15.964007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:15.971360 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-07994b6a-7175-49c0-a80e-753d62cb9283 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1144 microversion: 2.1 time: 0.082306 Aug 06 01:45:15.971927 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 553/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:15 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:16.680320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:16.682421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:16.690049 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:16.690525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:16.690956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:16.691647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:16.692084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:16.692506 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:16.721066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eca45a35-003c-4bd8-95c4-685cc056125a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 06 01:45:16.721624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 573/1126] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:16 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:16.992056 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:16.992670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:16.999605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.000186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.000697 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.001435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.001886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.002379 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.076329 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:17.083998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fb1f65be-5fd1-47a7-828f-81b867dc3222 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1136 microversion: 2.1 time: 0.095863 Aug 06 01:45:17.084571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 554/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:16 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1136 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:17.734282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:17.736782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:17.743295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.743801 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.744275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.745172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.745588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.746030 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.776360 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4ea316b4-f9e7-4402-aff9-4e48b1e12256 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046838 Aug 06 01:45:17.782964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 574/1128] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:45:17 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:45:17.840996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:17.841617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:17.848374 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.848933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.849466 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.850228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.850757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.851250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.878603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:45:17.959267 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cea224bf-0b8d-4ca8-a9e8-601d9d0bf9f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 204 len: 0 microversion: 2.1 time: 0.121972 Aug 06 01:45:17.960203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 555/1129] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:45:17 2022] DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 01:45:17.968699 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:17.969485 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:17.975408 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.975891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.976326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:17.977068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:17.977741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:17.978166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:18.106318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:18.107186 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:18.115137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:18.115634 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:18.116075 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:18.117096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:18.117567 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:18.118002 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:18.214484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:18.220775 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:18.225492 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3469dc9f-dc72-4aec-be4d-3d74b1a58c13 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1210 microversion: 2.1 time: 0.123323 Aug 06 01:45:18.226162 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 556/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:18 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:18.241500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4765e50d-5813-4b10-9dc8-bb2d6e801620 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1679 microversion: 2.1 time: 0.277237 Aug 06 01:45:18.242087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 575/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:17 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:19.248282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:19.249083 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:19.258390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:19.258390 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:19.259204 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:19.259915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:19.260527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:19.261089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:19.264656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:19.265546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:19.274302 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:19.275824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:19.276554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:19.277942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:19.278577 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:19.279306 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:19.809007 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:19.813589 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:19.818681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-bcd68eea-d05e-4d24-97b3-b1711574fa59 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1278 microversion: 2.1 time: 0.575489 Aug 06 01:45:19.819265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 557/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:19 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1278 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:19.826110 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:19.835246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d9640cae-061b-4864-b955-10b89fcd33a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1679 microversion: 2.1 time: 0.575171 Aug 06 01:45:19.836201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 576/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:19 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1679 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:20.617128 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b9f5c4-7b27-470b-baf3-0c427b43e4f4", "tag": "491218a5-9a0e-491f-a290-4e5203e90c7b"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:20.628475 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:20.629027 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:20.629555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:20.643269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] Creating event network-changed:491218a5-9a0e-491f-a290-4e5203e90c7b for instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 on hv-cinder-85200 Aug 06 01:45:20.647951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-cf78ca7f-f7ca-4a98-96c6-c5f0c30e1aa0 req-4b9d8d9b-2a91-4749-8243-fe41fdd7afc7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Aug 06 01:45:20.648768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 558/1134] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:45:20.843889 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:20.844588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:20.856404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:20.857236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:20.864194 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:20.864682 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:20.865152 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:20.865847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:20.866311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:20.866738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:20.871472 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:20.871981 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:20.872429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:20.873205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:20.873668 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:20.874627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:20.982058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:20.990228 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d34f42c7-bab5-4f15-b824-24c027f20acc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1612 microversion: 2.1 time: 0.137996 Aug 06 01:45:20.990804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 559/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:20 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1612 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:21.227762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:21.230209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:21.238223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8e941340-596d-4935-ae9a-3344fd8b0a88 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.398206 Aug 06 01:45:21.239050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 577/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:20 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:22.011828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:22.012454 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:22.014527 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:22.022026 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.022522 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.022964 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.023669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.024130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.024561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.056320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.056719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.057189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.057643 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'fault' on Instance uuid b83bb86e-3508-4057-a16d-d43f33bd56f2 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:45:22.100650 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:22.108230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9c98b700-2c83-4fd0-8ef1-931459d56f08 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 200 len: 1330 microversion: 2.1 time: 0.100300 Aug 06 01:45:22.109102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 560/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:22 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:22.260117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:22.260731 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:22.262585 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:22.269134 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.269630 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.270069 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.270773 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.271229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.271657 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.414886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:22.423260 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4cb5e44d-851f-44ef-8091-65f61e457755 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.166953 Aug 06 01:45:22.423864 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 578/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:22 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:22.663464 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83bb86e-3508-4057-a16d-d43f33bd56f2", "name": "network-vif-deleted", "tag": "9f7b31b0-6620-4723-98f0-bc0060df7aa2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:22.674953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:22.675693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:22.676123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:22.688701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] Creating event network-vif-deleted:9f7b31b0-6620-4723-98f0-bc0060df7aa2 for instance b83bb86e-3508-4057-a16d-d43f33bd56f2 on hv-cinder-85200 Aug 06 01:45:22.693420 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-3b54b730-5e9c-4a39-b387-14c8dda2093f req-9deb8923-3c3b-430f-9047-885233504c8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 Aug 06 01:45:22.694025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 561/1139] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:23.128755 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:23.129326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:23.135499 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:23.135979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:23.136411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:23.137108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:23.137558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:23.137977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:23.151522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 HTTP/1.1 Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:45:23.153018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:45:23.154715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'b83bb86e-3508-4057-a16d-d43f33bd56f2'} Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:45:23.156477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:45:23.158138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:45:23.159756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:45:23.159756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d0ca1ebd-3b81-486d-b2c3-73de45575d47 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 404 len: 111 microversion: 2.1 time: 0.029615 Aug 06 01:45:23.159756 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 579/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:23 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:45:23.165022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8fd5b8e8-6a8a-4712-a606-cf2eda80ed2a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '.version_select at 0x7fbff416fdc0>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:23.182951 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8fd5b8e8-6a8a-4712-a606-cf2eda80ed2a tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889046632" status: 202 len: 0 microversion: 2.1 time: 0.022694 Aug 06 01:45:23.183504 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 562/1141] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Aug 6 01:45:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889046632 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:45:23.444229 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:23.444880 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:23.451511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:23.452000 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:23.453213 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:23.453964 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:23.454421 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:23.454849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:23.648194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:23.651791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:23.656840 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d26716c2-3ae2-4856-b051-2e2fde1ad435 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.216919 Aug 06 01:45:23.657450 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 580/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:23 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:23.898049 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-64466573-c459-4414-90f9-748515fc6770 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: .version_select at 0x7fbff408f160>, body: {"keypair": {"name": "tempest-keypair-757579815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdqmFExnlxU32OoGjtSZ3twZlYSdVT6tcq5AVX2CxrjlmpOUmX+l8G3rVGncEi1sFCf6vGjRA2a+CnuHniOx9snRQ17HKtWtlvFVTSqDH7LFeDBJ0idh5BxgECt73B+Cg=="}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:23.913677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-64466573-c459-4414-90f9-748515fc6770 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:45:23.917409 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-64466573-c459-4414-90f9-748515fc6770 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:45:23.939200 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-64466573-c459-4414-90f9-748515fc6770 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045173 Aug 06 01:45:23.939784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 563/1143] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:45:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:24.678070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:24.678792 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:24.687278 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:24.687881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:24.688357 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:24.689084 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:24.689552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:24.689982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:24.911061 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:24.918796 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2bf55337-0547-4580-96e6-93511351e7b2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.244574 Aug 06 01:45:24.919501 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 581/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:24 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:25.294853 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1401085798", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "298c8e04-2f72-4e6a-a959-fe6b3ec17737"}], "security_groups": [{"name": "tempest-securitygroup--1642269507"}], "key_name": "tempest-keypair-757579815", "user_data": "}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:25.400925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] validate_networks() for [('298c8e04-2f72-4e6a-a959-fe6b3ec17737', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:45:25.939752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:25.940369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:25.946744 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:25.947235 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:25.947671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:25.948396 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:25.948867 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:25.949323 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:26.147857 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:26.155409 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c55a9803-51bc-4d88-a513-637af495ac48 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.219415 Aug 06 01:45:26.156794 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 582/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:25 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:26.183110 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:45:26.183560 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:45:26.184028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:45:26.184569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:45:26.184984 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:45:26.193957 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:26.194431 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:26.194858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:26.195601 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:26.196052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:26.196471 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:26.213547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:45:26.217414 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:45:26.229170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:45:26.231547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:45:26.279156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3c9bfa15-cd36-4772-b894-50ba44a6e67f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.989062 Aug 06 01:45:26.279798 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 564/1146] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:45:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:45:26.291609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5a76482b-b53d-4a74-9cd1-ad0f77617599 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:26.292246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5a76482b-b53d-4a74-9cd1-ad0f77617599 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:26.347702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5a76482b-b53d-4a74-9cd1-ad0f77617599 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:26.354616 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5a76482b-b53d-4a74-9cd1-ad0f77617599 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1241 microversion: 2.1 time: 0.066992 Aug 06 01:45:26.355525 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 583/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:26 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:27.176370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:27.177244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:27.183624 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:27.184113 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:27.184549 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:27.185276 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:27.185733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:27.186161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:27.316693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:27.324140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0c93fea9-ffc1-4c9f-818d-9cc41f57198f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.152225 Aug 06 01:45:27.324703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 565/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:27 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:27.376405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:27.377024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:27.383463 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:27.383952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:27.384391 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:27.385114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:27.385578 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:27.386007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:27.455762 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:27.463184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c8b6d3a8-38d7-4768-b719-5702264c1a15 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1301 microversion: 2.1 time: 0.091113 Aug 06 01:45:27.463754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 584/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:27 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:28.345768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:28.346348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:28.353683 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:28.354253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:28.354778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:28.355551 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:28.356088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:28.356578 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:28.487155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:28.488059 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:28.494220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:28.494701 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:28.495131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:28.495816 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:28.496534 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:28.496953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:28.576895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:28.585089 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ecacacd0-8d8e-4f5b-8bd9-72de74939981 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.243850 Aug 06 01:45:28.585659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 566/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:28 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:28.598542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:28.606277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b1f887d8-9a61-4305-9812-ae47b09a6e9c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1299 microversion: 2.1 time: 0.123637 Aug 06 01:45:28.607482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 585/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:28 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:29.533215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ee8dbb-7100-4b65-a559-d975439c4382", "tag": "e5ac8afc-2176-44d3-bde4-4b66679b4434"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:29.548401 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:29.548893 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:29.549432 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:29.560973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] Creating event network-changed:e5ac8afc-2176-44d3-bde4-4b66679b4434 for instance e8ee8dbb-7100-4b65-a559-d975439c4382 on hv-cinder-85200 Aug 06 01:45:29.567792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-0d474da9-0be7-4909-b9fd-80fbd17b50f5 req-4a3de48a-e2ff-48dd-8d7f-55ad2a265a61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040200 Aug 06 01:45:29.568622 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 567/1152] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:45:29.606759 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:29.607378 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:29.614190 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:29.614686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:29.615128 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:29.615827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:29.616615 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:29.617117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:29.629546 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:29.629887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:29.637218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:29.637721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:29.638738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:29.638886 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:29.639310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:29.640301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:29.918931 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:29.927087 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2a5d203c-cae5-47e1-8f21-6b431e6db5f0 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.302305 Aug 06 01:45:29.927666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 568/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:29 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:29.931011 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:29.939943 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e328a837-afec-430f-bd95-c07a66de4ecc tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.336810 Aug 06 01:45:29.940696 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 586/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:29 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:30.948563 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:30.949076 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:30.956201 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:30.961183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:30.961805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:30.965306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:30.965776 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:30.966502 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:30.966958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:30.967398 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:30.975419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:30.975913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:30.976348 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:30.977066 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:30.977724 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:30.978154 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:31.166195 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:31.171481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:31.174262 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-851641f7-dc6d-4fb9-8285-2e3dbf9ffeee tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.229689 Aug 06 01:45:31.174844 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 569/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:30 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:31.179335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-061f5962-23af-49a5-9cbd-63c167091f3b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.221895 Aug 06 01:45:31.179894 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 587/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:30 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:32.194822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:32.195485 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:32.199363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:32.199810 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:32.199978 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:32.205144 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:32.205703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:32.206367 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:32.207201 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:32.208203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:32.208345 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:32.208769 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:32.209034 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:32.209689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:32.210595 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:32.211170 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:32.211745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:32.512212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:32.517374 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:32.519994 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cf3527b0-b0ec-4d66-af58-3b5036c7f712 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.329039 Aug 06 01:45:32.525041 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-03ee2469-5af6-4290-a8bf-985b0091915d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.329479 Aug 06 01:45:32.525703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 588/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:32 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:32.529885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 570/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:32 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:33.082607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b9f5c4-7b27-470b-baf3-0c427b43e4f4", "name": "network-vif-plugged", "status": "completed", "tag": "491218a5-9a0e-491f-a290-4e5203e90c7b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:33.092074 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:33.092587 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:33.093018 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:33.104333 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] Creating event network-vif-plugged:491218a5-9a0e-491f-a290-4e5203e90c7b for instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 on hv-cinder-85200 Aug 06 01:45:33.110281 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-e3b44ba7-753c-4402-997a-8bb473f0177a req-06a8354c-e90a-4505-b271-af6b04dcfae0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095719 Aug 06 01:45:33.110813 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 589/1159] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:33.541124 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:33.541746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:33.548181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:33.548882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:33.549015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:33.549500 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:33.549938 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:33.550639 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:33.551100 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:33.551535 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:33.555078 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:33.555567 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:33.555996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:33.556718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:33.557200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:33.557738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:33.742664 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:33.750996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-475ff27a-f25d-4a7d-9b4e-6ddcd041efe7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.213725 Aug 06 01:45:33.751584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 571/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:33 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:33.752032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:33.759767 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eb25fe6d-ed3b-4c6f-924d-3c29bd808e17 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1266 microversion: 2.1 time: 0.217089 Aug 06 01:45:33.760317 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 590/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:33 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:34.771249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:34.771885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:34.778301 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:34.778781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:34.779212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:34.779503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:34.780470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:34.780729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:34.780895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:34.781341 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:34.787341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:34.787823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:34.788255 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:34.788944 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:34.789427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:34.789858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:34.973451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:34.982169 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:34.985088 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c85d9eb3-7314-42fd-ad15-bc32f91bddb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.217615 Aug 06 01:45:34.997097 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 572/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:34 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:34.997275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4131c3a9-8042-401c-a152-149290502ea9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1454 microversion: 2.1 time: 0.220766 Aug 06 01:45:34.997522 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 591/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:34 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:45:35.016932 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:35.017584 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:35.023760 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:35.024173 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:35.024826 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:35.025315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:35.026947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:35.026947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:35.163611 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:35.171322 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cf0b7de9-9725-477b-a58f-6417bc6d194a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1454 microversion: 2.1 time: 0.158189 Aug 06 01:45:35.171894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 573/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:35 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:36.008874 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:36.009511 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:36.011922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:36.018713 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:36.019436 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:36.020007 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:36.020748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:36.021240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:36.021671 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:36.219056 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:36.226703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-24a68aaf-cc32-445e-af85-bc7dfddda689 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.221701 Aug 06 01:45:36.227298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 592/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:36 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:37.031516 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ee8dbb-7100-4b65-a559-d975439c4382", "name": "network-vif-plugged", "status": "completed", "tag": "e5ac8afc-2176-44d3-bde4-4b66679b4434"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:37.038030 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:37.038768 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=10 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:37.043399 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:37.043821 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:37.044434 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:37.057278 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] Creating event network-vif-plugged:e5ac8afc-2176-44d3-bde4-4b66679b4434 for instance e8ee8dbb-7100-4b65-a559-d975439c4382 on hv-cinder-85200 Aug 06 01:45:37.062304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-9721e10c-b1cd-458e-910f-432bf9767382 req-91678f04-1c95-44d3-98eb-60f45bede720 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Aug 06 01:45:37.062915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 574/1166] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:37.162924 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b9f5c4-7b27-470b-baf3-0c427b43e4f4", "tag": "491218a5-9a0e-491f-a290-4e5203e90c7b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:37.167982 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:45:37.175860 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:37.176603 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:37.177042 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:37.192072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] Creating event network-changed:491218a5-9a0e-491f-a290-4e5203e90c7b for instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 on hv-cinder-85200 Aug 06 01:45:37.197741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-43fcfa6f-c163-4a00-a489-0a5be5b6e966 req-4c6da2f5-37d5-4a8d-9ac5-4f2f42214f04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038824 Aug 06 01:45:37.198988 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 593/1167] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:37.249855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:37.251212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:37.258534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:37.259161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:37.259701 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:37.260507 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:37.261127 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:37.261778 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:37.534223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:37.542020 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6214f44e-8d42-4b0b-9db0-32ea3ba0c063 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.296967 Aug 06 01:45:37.542761 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 575/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:37 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:38.565225 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:38.565941 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:38.572152 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:38.572638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:38.573098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:38.573799 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:38.574251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:38.574674 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:38.774564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:38.782763 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1360f110-8947-47d3-a5da-111cb814c91b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1367 microversion: 2.1 time: 0.223364 Aug 06 01:45:38.783341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 594/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:38 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:39.804063 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:39.804668 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:39.811131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:39.811604 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:39.812035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:39.813361 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:39.813817 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:39.814231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:39.942051 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:45:39.949534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-aab0db82-f288-49b9-9861-e5fd587428fb tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1555 microversion: 2.1 time: 0.149203 Aug 06 01:45:39.950101 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 576/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:45:39 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:45:39.970200 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:45:39.970719 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:45:39.977162 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:39.977638 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:39.978067 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:39.978746 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:39.979192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:39.979611 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:40.055519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ab80f34c-bbc5-40e2-ab86-4b84de3efaa9 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089623 Aug 06 01:45:40.056062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 595/1171] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:45:39 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:45:40.966342 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ee8dbb-7100-4b65-a559-d975439c4382", "tag": "e5ac8afc-2176-44d3-bde4-4b66679b4434"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:45:40.976717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:45:40.977231 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:45:40.977661 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:45:40.990833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] Creating event network-changed:e5ac8afc-2176-44d3-bde4-4b66679b4434 for instance e8ee8dbb-7100-4b65-a559-d975439c4382 on hv-cinder-85200 Aug 06 01:45:40.995753 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-deeabd67-ddec-4fdd-b6b0-d0b082b7b88a req-73d4078b-364b-4cbf-aab3-edb9c2460668 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Aug 06 01:45:40.996612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 577/1172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:46:18.133789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:46:18.134387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:46:56.240156 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=7 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:56.240909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=74 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:56.294223 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:46:56.294716 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:46:56.301503 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:46:56.301989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:46:56.302425 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:46:56.303108 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:46:56.303564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:46:56.303989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:46:56.326380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bff543f0-3848-4327-9a49-cab571ebfce7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/ips" status: 200 len: 147 microversion: 2.1 time: 0.089037 Aug 06 01:46:56.326923 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 596/1173] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:46:56 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/ips => generated 147 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:46:57.648602 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=14 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:57.649299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=86 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:57.654013 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f90b45a-51f9-4922-8471-0db5efc9193d"}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:46:57.656407 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:46:57.663694 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:46:57.664177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:46:57.664612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:46:57.665319 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:46:57.665779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:46:57.666203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:46:57.921793 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a8671432-8e86-4c20-9320-5cc53516fcde tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275163 Aug 06 01:46:57.922423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 578/1174] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:46:57 2022] POST /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:05.449294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f90b45a-51f9-4922-8471-0db5efc9193d"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:05.451761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:05.458737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.459228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.459669 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.460468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.460939 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.461417 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.540267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: POST /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments HTTP/1.1 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 74 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:47:05.542008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {"volumeAttachment": {"volumeId": "4f90b45a-51f9-4922-8471-0db5efc9193d"}} Aug 06 01:47:05.543743 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'server_id': 'e8ee8dbb-7100-4b65-a559-d975439c4382', 'body': {'volumeAttachment': {'volumeId': '4f90b45a-51f9-4922-8471-0db5efc9193d'}}} Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:05.544714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:05.546446 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 400 to user: Invalid volume: volume 4f90b45a-51f9-4922-8471-0db5efc9193d is already attached to instances: e8ee8dbb-7100-4b65-a559-d975439c4382 {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-85eb846f-69ff-45f8-8dd8-29191d718238 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098243 Aug 06 01:47:05.548144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 597/1175] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:47:05 2022] POST /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 01:47:05.608950 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:05.609509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:05.615866 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.616348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.616786 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.617512 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.617967 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.618419 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.698888 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'services' on Instance uuid e8ee8dbb-7100-4b65-a559-d975439c4382 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:47:05.770505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0f82e7ac-05fc-4f14-b00b-0f67c4fd684f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments/4f90b45a-51f9-4922-8471-0db5efc9193d" status: 202 len: 0 microversion: 2.1 time: 0.165517 Aug 06 01:47:05.771208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 579/1176] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:47:05 2022] DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments/4f90b45a-51f9-4922-8471-0db5efc9193d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:47:05.780290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:05.782586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:05.791505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.792095 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.792609 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.793355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:05.793819 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:05.794251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:05.824984 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-e8cb2087-442b-468b-b512-d76881edbdb5 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048787 Aug 06 01:47:05.825575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 598/1177] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:47:05 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:47:06.837999 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:06.840260 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:06.846789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:06.847273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:06.847708 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:06.848993 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:06.849479 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:06.849910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:06.879320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ef62136e-a7b0-4d52-bddf-d9a8be2d0c9f tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045611 Aug 06 01:47:06.880036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 580/1178] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:47:06 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 01:47:06.940379 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:06.940900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:06.947390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:06.947886 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:06.948309 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:06.949001 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:06.949482 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:06.949915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:06.975239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:47:07.066098 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-2c31c414-7dee-4854-81d5-7c20a9c25125 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 204 len: 0 microversion: 2.1 time: 0.128996 Aug 06 01:47:07.067550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 599/1179] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:47:06 2022] DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:47:07.076646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:07.077483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:07.084082 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:07.084568 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:07.085001 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:07.085724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:07.086183 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:07.086605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:07.219577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:07.227706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-710a229d-51c6-4253-b0dd-148fa6b2d597 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1679 microversion: 2.1 time: 0.155417 Aug 06 01:47:07.228265 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 581/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:07 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:08.249455 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:08.250144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:08.256376 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:08.256850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:08.257307 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:08.257983 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:08.258430 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:08.258848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:08.421197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:08.428907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-eaa4537a-800d-486e-ba35-dedbe3674fcd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1679 microversion: 2.1 time: 0.183925 Aug 06 01:47:08.429575 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 600/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:08 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:09.449345 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:09.450172 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:09.456895 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:09.457690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:09.458238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:09.458946 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:09.459403 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:09.459828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:09.686820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:09.694521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-44099a62-5eba-4683-ab4d-a2cee861ec1c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1679 microversion: 2.1 time: 0.249028 Aug 06 01:47:09.695094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 582/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:09 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:10.316440 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ee8dbb-7100-4b65-a559-d975439c4382", "name": "network-vif-deleted", "tag": "e5ac8afc-2176-44d3-bde4-4b66679b4434"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:10.329412 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:10.329987 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:10.330546 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:10.343024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] Creating event network-vif-deleted:e5ac8afc-2176-44d3-bde4-4b66679b4434 for instance e8ee8dbb-7100-4b65-a559-d975439c4382 on hv-cinder-85200 Aug 06 01:47:10.349282 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-151c5724-37a2-43ec-9265-246e099f5c9a req-3987deaa-e837-49c8-b0d5-c0d67929882a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036371 Aug 06 01:47:10.350922 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 601/1183] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:10.715856 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:10.717306 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:10.724577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:10.725099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:10.725588 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:10.726498 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:10.726958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:10.727389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:10.760548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:10.761065 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:10.761722 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:10.761941 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'fault' on Instance uuid e8ee8dbb-7100-4b65-a559-d975439c4382 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:47:10.811447 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:10.820603 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-026a4243-289b-4d08-be8d-5230d16d4b58 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 200 len: 1331 microversion: 2.1 time: 0.108693 Aug 06 01:47:10.821385 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 583/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:10 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:11.843254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:11.843945 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:11.850679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:11.851153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:11.851592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:11.852271 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:11.852721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:11.853172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:11.865966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 HTTP/1.1 Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:47:11.867552 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:47:11.869177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'e8ee8dbb-7100-4b65-a559-d975439c4382'} Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:47:11.870198 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:47:11.871754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:47:11.873471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:47:11.873471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-398c29d0-c0dd-49dd-b986-2bbc281ca601 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 404 len: 111 microversion: 2.1 time: 0.029818 Aug 06 01:47:11.873471 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 602/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:11 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:47:11.878908 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ac1f7cd3-5d9a-443a-a574-1468c32b3c90 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '.version_select at 0x7fbff4167a60>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:11.897998 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ac1f7cd3-5d9a-443a-a574-1468c32b3c90 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757579815" status: 202 len: 0 microversion: 2.1 time: 0.023113 Aug 06 01:47:11.898566 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 584/1186] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Aug 6 01:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757579815 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:47:12.518882 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-4aa95dd6-af66-49e8-abf4-f8c9edf42902 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: .version_select at 0x7fbff7ee4280>, body: {"keypair": {"name": "tempest-keypair-1623633705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUp313zwCVkKXsv2jw1/2dIGVThRwQIkpjNtW4CMwWKB0aPdI0vV5FnwT2LYAfLM2GRtgpJgNfdeLsywsTlK6TRkenPnghHVv3Pn5VilBUO8q4F96T75LHb3A46Twrmhw=="}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:12.534733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-4aa95dd6-af66-49e8-abf4-f8c9edf42902 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:47:12.539183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-4aa95dd6-af66-49e8-abf4-f8c9edf42902 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'key_pairs'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:47:12.564481 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-4aa95dd6-af66-49e8-abf4-f8c9edf42902 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049570 Aug 06 01:47:12.565111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 603/1187] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Aug 6 01:47:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:13.780264 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-917205449", "imageRef": "47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "298c8e04-2f72-4e6a-a959-fe6b3ec17737"}], "security_groups": [{"name": "tempest-securitygroup--757298872"}], "key_name": "tempest-keypair-1623633705", "user_data": "}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:13.887321 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] validate_networks() for [('298c8e04-2f72-4e6a-a959-fe6b3ec17737', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:47:14.287857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:47:14.288290 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:47:14.288784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:47:14.289246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:47:14.289667 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:47:14.300577 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:14.301132 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:14.301679 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:14.302438 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:14.302901 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:14.303332 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:14.321434 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:47:14.326073 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Getting quotas for user d2235317fe8d4d7ebae7bb5b80dfd7e6 and project 7906e11569cc47778d8ed1c6b371ae4d. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:47:14.340234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:47:14.342717 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47db7dfe-5fc5-4f24-b30a-6ff1c6cf2130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:47:14.396738 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-669395c1-82b5-4ed4-9910-49a91d16afad tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621156 Aug 06 01:47:14.397671 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 585/1188] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:47:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:47:14.411429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1e783cc4-7fcc-4dca-9fe8-fb060443e3d4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:14.413328 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1e783cc4-7fcc-4dca-9fe8-fb060443e3d4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:14.474782 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1e783cc4-7fcc-4dca-9fe8-fb060443e3d4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:14.482036 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1e783cc4-7fcc-4dca-9fe8-fb060443e3d4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1241 microversion: 2.1 time: 0.075274 Aug 06 01:47:14.482686 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 604/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:14 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:15.503733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:15.504721 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:15.510902 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:15.511693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:15.512138 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:15.512851 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:15.513334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:15.513779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:15.588912 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:15.596732 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cbcfda48-91fb-496b-843a-ff26c9a6448d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1311 microversion: 2.1 time: 0.097376 Aug 06 01:47:15.597398 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 586/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:15 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:16.618741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:16.619353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:16.626322 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:16.626811 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:16.627240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:16.627932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:16.628382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:16.628807 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:16.833238 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:16.840714 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-20ed8dd6-7afa-4238-b2d5-92a6b945cc45 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.225791 Aug 06 01:47:16.841256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 605/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:16 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:16.926653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1d1498-4c40-4819-b5e0-6c80f90a6ba0", "tag": "e429c272-2356-47fd-a328-62e3c7404401"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:16.937036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:16.948252 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:16.948751 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:16.964417 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] Creating event network-changed:e429c272-2356-47fd-a328-62e3c7404401 for instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 on hv-cinder-85200 Aug 06 01:47:16.969465 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-f2dfa4ef-3bb2-4dbf-96f4-961432b55700 req-915576ff-7646-4e33-be44-702e81df3623 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046650 Aug 06 01:47:16.970081 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 587/1192] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:17.861851 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:17.862461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:17.869031 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:17.869539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:17.869977 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:17.870670 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:17.871127 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:17.871554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:17.997899 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:18.005654 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-819e1758-c785-4eb3-86e7-ffdd19b0cfb3 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.147656 Aug 06 01:47:18.006214 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 606/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:17 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:19.027526 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:19.028258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:19.034395 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:19.034880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:19.036031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:19.036723 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:19.037215 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:19.037642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:19.169370 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:19.177855 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-9b58e3f5-25dc-481e-8607-83aa887185cc tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.155040 Aug 06 01:47:19.178425 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 588/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:19 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:20.198720 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:20.199324 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:20.205679 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:20.206158 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:20.206591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:20.208220 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:20.208685 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:20.209144 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:20.339605 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:20.346940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b01a473d-ba1f-42a9-91a0-5b3fa69801ef tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.152219 Aug 06 01:47:20.347512 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 607/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:20 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:21.367393 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:21.368033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:21.374746 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:21.375230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:21.375669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:21.376357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:21.376816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:21.377274 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:21.505185 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:21.512612 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4a717198-6b4f-4d55-82f4-2145216cc7a4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.149287 Aug 06 01:47:21.513207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 589/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:21 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:22.533117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:22.533753 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:22.540663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:22.541184 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:22.541624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:22.542320 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:22.542776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:22.543206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:22.673362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:22.680839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-005d067f-5b1d-4119-b333-4444ca819cd4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.151664 Aug 06 01:47:22.681449 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 608/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:22 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:23.701460 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:23.702074 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:23.708545 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:23.709015 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:23.709521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:23.710298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:23.710755 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:23.711179 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:23.716520 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1d1498-4c40-4819-b5e0-6c80f90a6ba0", "name": "network-vif-plugged", "status": "completed", "tag": "e429c272-2356-47fd-a328-62e3c7404401"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:23.728194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:23.728194 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:23.728715 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:23.744087 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] Creating event network-vif-plugged:e429c272-2356-47fd-a328-62e3c7404401 for instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 on hv-cinder-85200 Aug 06 01:47:23.749596 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-e14b7b16-bca0-48a8-ad5c-19bd107d2ec5 req-5c04c969-383e-4994-9388-685611745a05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038199 Aug 06 01:47:23.750504 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 609/1198] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:47:23.852218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:23.860035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1c3ed22c-9f28-4181-9912-65a595c4ef35 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.162432 Aug 06 01:47:23.860617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 590/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:23 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:24.879918 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:24.885209 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:24.885907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:24.892343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:24.892823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:24.893275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:24.893950 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:24.895427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:24.895858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:25.027557 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:25.035599 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a3c67c9f-8634-4525-8ca4-cb43c47665f8 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1366 microversion: 2.1 time: 0.156447 Aug 06 01:47:25.036174 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 610/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:24 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:26.055666 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:26.056286 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:26.058242 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:26.058887 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:26.064889 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:26.065396 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:26.065825 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:26.066627 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:26.067078 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:26.067499 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:26.195782 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:26.203211 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-dd24d640-16a1-41a4-b653-687eb3ccace7 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1555 microversion: 2.1 time: 0.151475 Aug 06 01:47:26.203771 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 591/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:26 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:26.224644 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:26.225219 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:26.231071 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:26.231551 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:26.232089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:26.232774 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:26.233263 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:26.233689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:26.248329 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:26.312405 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-ac0a8a30-a775-4c18-801a-aaaa7ceeb6db tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092256 Aug 06 01:47:26.313005 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 611/1202] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Aug 6 01:47:26 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:27.477455 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1d1498-4c40-4819-b5e0-6c80f90a6ba0", "tag": "e429c272-2356-47fd-a328-62e3c7404401"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:27.487311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:27.487885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:27.488954 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:27.500022 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] Creating event network-changed:e429c272-2356-47fd-a328-62e3c7404401 for instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 on hv-cinder-85200 Aug 06 01:47:27.505156 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-9c309873-04f2-46fb-ba27-b4097a45d84d req-911faf70-ea9b-47d8-bb35-ea714ed33646 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031293 Aug 06 01:47:27.506061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 592/1203] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:52.369888 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:52.370683 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:52.375254 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:52.375748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:52.383135 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:52.383624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:52.384062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:52.384748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:52.385233 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:52.385663 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:52.413259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:47:52.488650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-bfc00711-3a48-4b79-973f-a3e644620514 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 204 len: 0 microversion: 2.1 time: 0.119947 Aug 06 01:47:52.490377 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 612/1204] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:47:52 2022] DELETE /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:47:52.496177 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:52.496918 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:47:52.501308 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:52.502006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:52.513095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:52.513658 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:52.514107 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:52.514816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:52.515275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:52.515706 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:52.701547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:52.709781 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-46ccc173-1127-46fd-9bd7-49356e61455d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1578 microversion: 2.1 time: 0.215279 Aug 06 01:47:52.710408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 593/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:52 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:53.731627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:53.732323 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:53.738633 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:53.739109 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:53.739539 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:53.741416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:53.741871 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:53.742294 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:53.925802 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:53.934461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3354511a-4a2b-4861-a0c0-c63568cf391e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1578 microversion: 2.1 time: 0.207094 Aug 06 01:47:53.935024 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 613/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:53 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:54.600181 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:47:54.600400 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:47:54.955496 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:54.956208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:54.962805 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:54.963293 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:54.963725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:54.964415 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:54.964865 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:54.965315 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:55.050443 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:55.058569 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-340044d0-e69f-418b-9344-4c5d8749c2c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 200 len: 1510 microversion: 2.1 time: 0.106904 Aug 06 01:47:55.059158 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 594/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:54 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:55.163697 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b9f5c4-7b27-470b-baf3-0c427b43e4f4", "name": "network-vif-deleted", "tag": "491218a5-9a0e-491f-a290-4e5203e90c7b"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:55.175646 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:55.176131 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:55.176659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:55.193362 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] Creating event network-vif-deleted:491218a5-9a0e-491f-a290-4e5203e90c7b for instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 on hv-cinder-85200 Aug 06 01:47:55.201260 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-711ea7b2-dcc1-4388-a1bb-0ea69d5801c6 req-fddc7904-842f-4ced-bff0-0a28e68acc86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041842 Aug 06 01:47:55.201966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 614/1208] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:47:56.079812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:56.080408 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:56.088608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:56.089131 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:56.089571 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:56.090280 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:56.090740 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:56.091167 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:56.105657 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] HTTP exception thrown: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Request method failure captured: Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 HTTP/1.1 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ceI_C2-c7Vj0aQSAjlvN7agCWqEZR32VVciYWVClRhqS8t0C_A-use7UGOUx3R0CzEMtkVeJgIw8ZlLcGgrsPWSbWONphGNljb87fE27f1HXs_Noes9YOzOoc1PXGVUuWxdNV9ooBSp78bZdlF9glHP7xKdC0OtquN9Bd-AxhSilnw Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:47:56.107348 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}] Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestVolumeBootPattern-584244258 Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 6ac05cb43bb146cbb0a548ff3148a77a Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:47:56.108903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '19b9f5c4-7b27-470b-baf3-0c427b43e4f4'} Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:47:56.109832 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:47:56.111238 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:47:56.112515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Returning 404 to user: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:47:56.112515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a6abffb2-44df-414d-ab2d-80ca504aea46 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 404 len: 111 microversion: 2.1 time: 0.032853 Aug 06 01:47:56.112515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 595/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:56 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:47:56.160725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1671477993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895415522", "security_groups": [{"name": "tempest-secgroup-smoke-1814580085"}], "block_device_mapping_v2": [{"uuid": "ea04d095-2a33-4ef9-92f7-f53fedf8448d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3bc265c-51c9-44de-a207-e5ab970830b8"}]}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:56.279700 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.network.neutron [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] validate_networks() for [('a3bc265c-51c9-44de-a207-e5ab970830b8', None, None, None, None, None)] {{(pid=124313) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:47:56.647068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:47:56.647488 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image limits 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:47:56.647962 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:47:56.648372 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image pref 0:0:0 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:47:56.648805 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.virt.hardware [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124313) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:47:56.657461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:56.657938 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:56.658368 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:56.659089 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:56.659541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:56.659963 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:56.676745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:47:56.681349 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.quota [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for user 6ac05cb43bb146cbb0a548ff3148a77a and project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124313) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:47:56.736015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Going to run 1 instances... {{(pid=124313) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:47:56.738218 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea04d095-2a33-4ef9-92f7-f53fedf8448d',volume_size=None,volume_type=None)] {{(pid=124313) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:47:56.866341 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-3ee59ff6-4e06-4d4b-823f-c0c6e49fa53a tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709769 Aug 06 01:47:56.867008 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 615/1210] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:47:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 01:47:56.878019 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cbec73c8-fc2f-485d-ba8d-75a77821f7cd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:56.878625 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cbec73c8-fc2f-485d-ba8d-75a77821f7cd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:56.932169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-cbec73c8-fc2f-485d-ba8d-75a77821f7cd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:56.939060 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cbec73c8-fc2f-485d-ba8d-75a77821f7cd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1095 microversion: 2.1 time: 0.064900 Aug 06 01:47:56.939623 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 596/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:56 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:57.959776 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:57.960385 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:57.968383 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:57.968967 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:57.969434 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:57.970143 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:57.970761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:57.971275 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:58.079334 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:58.087703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c0b6eb4c-d840-4140-9506-e8f254feeedd tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1201 microversion: 2.1 time: 0.131661 Aug 06 01:47:58.089868 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 616/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:57 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:59.107933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:47:59.108463 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:47:59.116300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:59.116797 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:59.117352 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:59.118061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:59.118547 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:59.118974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:59.359687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:47:59.368010 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-c89525b6-9469-4264-88d9-62cbe29af8c6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.264084 Aug 06 01:47:59.368582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 597/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:47:59 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:47:59.696913 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b92da12-7de0-4665-ab69-660d55eadde7", "tag": "7069deae-4b84-4d2b-8ec0-d4dbf9f163f2"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:47:59.707495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:47:59.708177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:47:59.708912 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:47:59.721291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] Creating event network-changed:7069deae-4b84-4d2b-8ec0-d4dbf9f163f2 for instance 3b92da12-7de0-4665-ab69-660d55eadde7 on hv-cinder-85200 Aug 06 01:47:59.726745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-646e180d-52fd-440e-9a3c-d63106d17f9f req-cd88cec2-21e0-4c74-bd04-48d645fe63ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034575 Aug 06 01:47:59.727369 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 617/1214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:48:00.390111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:00.390758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:00.398222 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:00.398357 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:00.398703 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:00.399404 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:00.399858 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:00.400284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:00.535230 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:00.542641 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-526a38aa-a86f-433f-a50f-555120f4dce8 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.156514 Aug 06 01:48:00.543208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 598/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:00 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:01.564033 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:01.564726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:01.571048 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:01.571524 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:01.571952 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:01.572693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:01.573186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:01.573639 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:01.708651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:01.716028 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-653ce711-9042-49c7-9dfb-fd56595aa22b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.156637 Aug 06 01:48:01.716591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 618/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:01 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:02.736836 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:02.737505 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:02.744608 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:02.745123 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:02.745601 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:02.746294 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:02.746754 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:02.747184 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:02.875925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:02.883618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-67de6e5b-4e1c-4cd1-93c5-eea7c0887d74 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.150639 Aug 06 01:48:02.884192 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 599/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:02 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:03.903976 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:03.904514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:03.910911 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:03.911390 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:03.911821 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:03.912527 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:03.912954 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:03.913401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:04.046038 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:04.054151 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-902a29c9-a0d8-4ca0-9594-c65d19edf064 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.153403 Aug 06 01:48:04.054729 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 619/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:03 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:05.075298 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:05.075905 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:05.082484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:05.082988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:05.083423 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:05.084124 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:05.085285 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:05.085709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:05.212861 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:05.221595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-41b46cbf-d28e-4cf2-910b-36dbf30cf41c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.150201 Aug 06 01:48:05.222166 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 600/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:05 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:06.242256 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:06.242891 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:06.250182 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:06.250613 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:06.251050 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:06.251745 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:06.252197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:06.252620 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:06.385337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:06.392732 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-01b3baf9-1779-4231-b115-00700d38e735 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.154438 Aug 06 01:48:06.393338 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 620/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:06 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:07.413659 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:07.414300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:07.416585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:07.422035 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:07.422532 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:07.422966 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:07.423662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:07.424118 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:07.424544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:07.555837 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:07.563218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fa9c06ca-52b0-4f78-bd52-3bf6a72be4ed tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.153856 Aug 06 01:48:07.563812 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 601/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:07 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:08.584258 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:08.584892 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:08.586851 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:08.587500 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=6 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:08.593942 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:08.594427 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:08.594865 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:08.595550 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:08.596003 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:08.596429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:08.727435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:08.735543 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-248293b8-8d5b-4a32-9290-2def680ba665 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.155156 Aug 06 01:48:08.736114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 621/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:08 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:09.756614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:09.757469 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:09.763857 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:09.764339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:09.764773 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:09.765490 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:09.765947 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:09.766369 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:09.904115 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:09.911531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-6e3fa92c-b2ab-436e-b67d-af3d02801678 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.159247 Aug 06 01:48:09.912102 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 602/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:09 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:10.932277 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:10.932936 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:10.939247 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:10.939723 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:10.940155 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:10.940835 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:10.941319 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:10.941742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:11.071932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:11.079295 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-51697df7-3cfb-4559-95d9-b4d310de630f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.151001 Aug 06 01:48:11.079854 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 622/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:10 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:11.987610 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b92da12-7de0-4665-ab69-660d55eadde7", "name": "network-vif-plugged", "status": "completed", "tag": "7069deae-4b84-4d2b-8ec0-d4dbf9f163f2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:48:11.998827 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:11.999339 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:11.999758 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:12.011958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] Creating event network-vif-plugged:7069deae-4b84-4d2b-8ec0-d4dbf9f163f2 for instance 3b92da12-7de0-4665-ab69-660d55eadde7 on hv-cinder-85200 Aug 06 01:48:12.016885 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-1ed55206-7a86-436c-862c-d12cc7d46752 req-01feffa9-1b1a-4f28-816f-c5170fbd2159 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Aug 06 01:48:12.017525 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 603/1225] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:48:12.099829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:12.101197 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:12.107507 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:12.108022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:12.108467 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:12.109192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:12.109655 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:12.110124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:12.258881 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:12.266387 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-1545b55e-f99c-4407-a6e5-72e0e02c2ba4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.170553 Aug 06 01:48:12.267047 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 623/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:12 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:13.289303 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:13.289985 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:13.296036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:13.296515 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:13.296948 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:13.297662 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:13.298124 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:13.298530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:13.431406 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:13.438930 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-f9410067-de62-4c62-8b9b-a9eeec39d999 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1267 microversion: 2.1 time: 0.154935 Aug 06 01:48:13.439511 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 604/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:13 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:48:14.459588 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:14.460192 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:14.466642 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:14.467126 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:14.467564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:14.468249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:14.468703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:14.469153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:14.601340 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:14.608818 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-55255b41-7c2f-4ad8-91ee-5c8a6ab17374 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1454 microversion: 2.1 time: 0.153152 Aug 06 01:48:14.609422 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 624/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:14 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:14.629070 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:14.629690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:14.636542 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:14.637025 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:14.637497 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:14.638188 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:14.638640 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:14.639062 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:14.767216 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:14.774680 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-3dfd833e-3b88-4e2e-bbf9-e34ecac10d61 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1454 microversion: 2.1 time: 0.149397 Aug 06 01:48:14.775249 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 605/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:14 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:16.484618 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b92da12-7de0-4665-ab69-660d55eadde7", "tag": "7069deae-4b84-4d2b-8ec0-d4dbf9f163f2"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:48:16.495518 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:16.495994 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:16.496418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:16.507689 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] Creating event network-changed:7069deae-4b84-4d2b-8ec0-d4dbf9f163f2 for instance 3b92da12-7de0-4665-ab69-660d55eadde7 on hv-cinder-85200 Aug 06 01:48:16.512726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-6ed7f5ac-c8c9-483e-a57b-8febaa0e8ad8 req-b5702418-cafa-4e15-9c18-fd7fbc8ef7c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Aug 06 01:48:16.513353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 625/1230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:48:42.703681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:42.704255 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:42.706310 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=28 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:42.706990 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=64 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:42.712718 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:42.713237 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:42.713675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:42.714372 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:42.714830 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:42.715258 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:42.738509 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-77532132-8ee7-4b73-af9c-b3f99a207009 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038826 Aug 06 01:48:42.739079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 606/1231] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Aug 6 01:48:42 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:48:44.059651 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:44.060380 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:48:44.065123 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08aac7e1-3e41-4d06-9bf4-319344a782cb"}} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:48:44.067519 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:44.076583 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:44.077139 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:44.077658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:44.078337 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:44.078789 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:44.079227 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:44.344591 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b0e635f8-1c3d-4007-94a7-ac0d2104781c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "POST /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286275 Aug 06 01:48:44.345240 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 626/1232] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Aug 6 01:48:44 2022] POST /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:48:51.958852 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:51.959412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:51.965446 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:51.965921 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:51.966349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:51.967028 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:51.967477 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:51.967892 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:52.046725 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.objects.instance [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lazy-loading 'services' on Instance uuid 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 {{(pid=124314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 01:48:52.116792 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-d5f9202e-ec4c-413c-80a1-035e878b20cd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments/08aac7e1-3e41-4d06-9bf4-319344a782cb" status: 202 len: 0 microversion: 2.1 time: 0.161697 Aug 06 01:48:52.118349 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 607/1233] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Aug 6 01:48:51 2022] DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments/08aac7e1-3e41-4d06-9bf4-319344a782cb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:48:52.128172 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:52.130728 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:52.138124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:52.138621 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:52.139093 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:52.139791 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:52.140249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:52.140680 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:52.170703 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-162d7e12-d8fb-4590-aa49-725cd1e43a09 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 Aug 06 01:48:52.171269 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 627/1234] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:48:52 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:48:53.183654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:53.185963 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:53.192731 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.193253 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.193692 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.194375 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.194829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.195250 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.224163 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1a5e0189-9bc1-4d2f-88bd-f2135cb310b4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045384 Aug 06 01:48:53.224707 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 608/1235] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Aug 6 01:48:53 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 01:48:53.284956 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:53.285491 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:53.291953 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.292442 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.292883 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.293608 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.294068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.294495 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.319246 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:48:53.392163 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-cb3ae51d-58a9-47c8-8381-63444751280b tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 204 len: 0 microversion: 2.1 time: 0.110708 Aug 06 01:48:53.392848 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 628/1236] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:48:53 2022] DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:48:53.401112 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:53.401961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:53.408270 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.408764 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.409445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.410161 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:53.410616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:53.411044 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:53.540561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:53.548386 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-fbcf8ef6-aa72-45ad-a022-e1ea286da8dd tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1680 microversion: 2.1 time: 0.151129 Aug 06 01:48:53.548988 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 609/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:53 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 01:48:54.570068 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:54.571265 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:54.577812 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:54.578292 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:54.578725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:54.579401 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:54.579849 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:54.580268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:54.715772 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:54.723237 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-f4e5bbdf-6ddf-4161-a9bc-4e42eb59cde4 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1680 microversion: 2.1 time: 0.157412 Aug 06 01:48:54.723804 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 629/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:54 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:55.744061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:55.744840 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:55.751911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:55.752521 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:55.752969 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:55.753709 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:55.754170 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:55.754598 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:56.122096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2235317fe8d4d7ebae7bb5b80dfd7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7906e11569cc47778d8ed1c6b371ae4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:48:56.129944 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-ac26dd84-d6e1-4b0d-9fa6-55a7b3b3439c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 200 len: 1680 microversion: 2.1 time: 0.389834 Aug 06 01:48:56.130605 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 610/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:55 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 1680 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:48:56.445189 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1d1498-4c40-4819-b5e0-6c80f90a6ba0", "name": "network-vif-deleted", "tag": "e429c272-2356-47fd-a328-62e3c7404401"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:48:56.456125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:56.456693 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:56.457228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:56.471542 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] Creating event network-vif-deleted:e429c272-2356-47fd-a328-62e3c7404401 for instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 on hv-cinder-85200 Aug 06 01:48:56.478085 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-61b8e97d-940c-4c01-bf4c-2ce11f52d668 req-5bc787a1-a0ab-40a9-bed8-2a9992e8bae2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036184 Aug 06 01:48:56.478858 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 630/1240] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:48:57.152282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:57.152833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:57.159212 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:57.159696 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:57.160139 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:57.160835 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:57.161341 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:57.161767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:57.175299 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 HTTP/1.1 Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:48:57.176949 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:57.178617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '9f1d1498-4c40-4819-b5e0-6c80f90a6ba0'} Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:48:57.179537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:57.181943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:57.183236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:48:57.183236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2b4185eb-2d0f-49bf-8f5d-4afc6ae4a686 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 404 len: 111 microversion: 2.1 time: 0.030454 Aug 06 01:48:57.183236 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 611/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:57 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:48:57.188267 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-fce5aa0a-a9c8-4588-be9c-99c37f5f5480 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '.version_select at 0x7fbff7f0f1f0>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:57.209831 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-fce5aa0a-a9c8-4588-be9c-99c37f5f5480 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623633705" status: 202 len: 0 microversion: 2.1 time: 0.025578 Aug 06 01:48:57.210418 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 631/1242] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Aug 6 01:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623633705 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:48:58.984594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:58.985111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:58.991416 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:58.991892 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:58.992325 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:58.993273 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:58.993733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:58.994164 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:59.007672 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 HTTP/1.1 Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:48:59.009756 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.011474 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '9f1d1498-4c40-4819-b5e0-6c80f90a6ba0'} Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:48:59.012613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.014363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.016096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:48:59.016096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-90c5976f-67b9-452b-b874-5a1e385636ec tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 404 len: 111 microversion: 2.1 time: 0.030421 Aug 06 01:48:59.016096 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 612/1243] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:48:58 2022] DELETE /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:48:59.019959 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:48:59.020691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:48:59.027419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:59.027900 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:59.028335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:59.029020 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:48:59.029505 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:48:59.029932 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:48:59.042966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 HTTP/1.1 Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:48:59.044573 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.046316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '9f1d1498-4c40-4819-b5e0-6c80f90a6ba0'} Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:48:59.047410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. Aug 06 01:48:59.048996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:48:59.050484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance 9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:48:59.050484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-97a10ec0-ca2c-47b2-aee4-61f8d809f79d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0" status: 404 len: 111 microversion: 2.1 time: 0.030278 Aug 06 01:48:59.050484 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 632/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:48:59 2022] GET /compute/v2.1/servers/9f1d1498-4c40-4819-b5e0-6c80f90a6ba0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:49:00.181143 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:00.181642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:00.187910 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.188392 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.188823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.189535 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.189989 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.190413 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.203514 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 HTTP/1.1 Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:49:00.205036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.206736 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'e8ee8dbb-7100-4b65-a559-d975439c4382'} Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:00.207733 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.209435 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.211085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:00.211085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-03cdcaec-62ef-4d95-af62-e27781ac4535 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 404 len: 111 microversion: 2.1 time: 0.029095 Aug 06 01:49:00.211085 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 613/1245] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:49:00 2022] DELETE /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:49:00.215311 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:00.215927 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: e8ee8dbb-7100-4b65-a559-d975439c4382] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:00.222367 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.222857 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.223331 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.224058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.224564 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.224996 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.238916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 HTTP/1.1 Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:49:00.240435 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.242242 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'e8ee8dbb-7100-4b65-a559-d975439c4382'} Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:00.243617 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. Aug 06 01:49:00.245416 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.246884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance e8ee8dbb-7100-4b65-a559-d975439c4382 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:00.246884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-beae7f88-12f7-40e2-ae91-886fc44a5c16 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382" status: 404 len: 111 microversion: 2.1 time: 0.030917 Aug 06 01:49:00.246884 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 633/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:49:00 2022] GET /compute/v2.1/servers/e8ee8dbb-7100-4b65-a559-d975439c4382 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:49:00.250544 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:00.251033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:00.256943 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.257449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.257879 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.258585 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.259030 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.259449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.272282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e HTTP/1.1 Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:49:00.274389 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.276198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'd3d42c75-08f4-4f77-860f-77c6adc4e82e'} Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:00.277223 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.278850 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.280757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:00.280757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-802a2099-c3d2-4cd5-ae84-6c88edb7cb3c tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 404 len: 111 microversion: 2.1 time: 0.029317 Aug 06 01:49:00.280757 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 614/1247] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:49:00 2022] DELETE /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 01:49:00.284594 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:00.285262 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: d3d42c75-08f4-4f77-860f-77c6adc4e82e] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:00.292276 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.292761 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.293228 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.293916 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:00.294411 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:00.294839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:00.307966 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e HTTP/1.1 Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:49:00.309513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.311253 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'd3d42c75-08f4-4f77-860f-77c6adc4e82e'} Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:00.312273 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. Aug 06 01:49:00.313659 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:00.314989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance d3d42c75-08f4-4f77-860f-77c6adc4e82e could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:00.314989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-40dc88e4-129c-4586-b4c7-47da70d90fa2 tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e" status: 404 len: 111 microversion: 2.1 time: 0.030734 Aug 06 01:49:00.314989 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 634/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:49:00 2022] GET /compute/v2.1/servers/d3d42c75-08f4-4f77-860f-77c6adc4e82e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:49:01.448649 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:01.449800 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:01.456198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:01.456677 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:01.457137 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:01.457831 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:01.458289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:01.458714 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:01.472086 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 HTTP/1.1 Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:49:01.473651 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.475358 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': 'b83bb86e-3508-4057-a16d-d43f33bd56f2'} Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:01.476412 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.478203 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.479862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:01.479862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-a239f4dc-8746-4582-9685-c84f32ef2f0d tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 404 len: 111 microversion: 2.1 time: 0.030485 Aug 06 01:49:01.479862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 615/1249] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:49:01 2022] DELETE /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:49:01.483570 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:49:01.484186 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] [instance: b83bb86e-3508-4057-a16d-d43f33bd56f2] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:49:01.490592 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:01.491076 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:01.491514 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:01.492205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:49:01.493204 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:49:01.493639 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:49:01.507742 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] HTTP exception thrown: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Request method failure captured: Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 HTTP/1.1 Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ca7V1L755HqZpFVKgUtTNuuS9PtfHc0SVjESMLygrxE5IN2ao361YxhJnGN5zPod1S8-3eqJ6Ck03p1sQtmJouQgT9TEdA2DYYKlch5s2Zz80Vp8rOaqM_D9LDRfyrj4PdMWoTYjSWYU6PMFduNHbc7M0H3RnbNN-2IQ2E6yFn0qEI Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:49:01.510251 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7906e11569cc47778d8ed1c6b371ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7906e11569cc47778d8ed1c6b371ae4d"}]}] Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 7906e11569cc47778d8ed1c6b371ae4d Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753305108 Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: d2235317fe8d4d7ebae7bb5b80dfd7e6 Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-AttachVolumeNegativeTest-1753305108-project Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.511829 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': 'b83bb86e-3508-4057-a16d-d43f33bd56f2'} Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:49:01.512650 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. Aug 06 01:49:01.514243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:49:01.515658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] Returning 404 to user: Instance b83bb86e-3508-4057-a16d-d43f33bd56f2 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:49:01.515658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-c7bc658c-cb43-4f0b-8423-5c3fb6d0c10e tempest-AttachVolumeNegativeTest-1753305108 tempest-AttachVolumeNegativeTest-1753305108-project] 10.222.0.26 "GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2" status: 404 len: 111 microversion: 2.1 time: 0.031916 Aug 06 01:49:01.515658 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 635/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:49:01 2022] GET /compute/v2.1/servers/b83bb86e-3508-4057-a16d-d43f33bd56f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:50:18.593961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:50:18.594654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:50:19.515058 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=20 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:19.515804 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:19.519700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2070692873", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1895415522", "security_groups": [{"name": "tempest-secgroup-smoke-1814580085"}], "block_device_mapping_v2": [{"uuid": "37b73cd6-c6e2-4f01-ae1e-05cb325af8e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3bc265c-51c9-44de-a207-e5ab970830b8"}]}} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:50:19.633282 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.network.neutron [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] validate_networks() for [('a3bc265c-51c9-44de-a207-e5ab970830b8', None, None, None, None, None)] {{(pid=124314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 01:50:19.999180 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 01:50:19.999595 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image limits 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 01:50:20.000114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Flavor pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 01:50:20.000537 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Image pref 0:0:0 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 01:50:20.000939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.virt.hardware [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 01:50:20.010108 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:20.010582 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:20.011012 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:20.011724 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:20.012169 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:20.012591 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:20.029658 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 01:50:20.033555 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.quota [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Getting quotas for user 6ac05cb43bb146cbb0a548ff3148a77a and project 3bea2c3f927a4bccb59065a8380b98c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 01:50:20.090652 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Going to run 1 instances... {{(pid=124314) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 01:50:20.092719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37b73cd6-c6e2-4f01-ae1e-05cb325af8e9',volume_size=None,volume_type=None)] {{(pid=124314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 01:50:20.218261 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-cc86c53f-1e31-41fe-851f-1fa2d7efde7f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704978 Aug 06 01:50:20.218897 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 616/1251] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Aug 6 01:50:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 01:50:20.231461 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-422ae114-5047-4a79-b27c-dc70facac52c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:20.232058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-422ae114-5047-4a79-b27c-dc70facac52c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:20.234468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:20.235103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:20.298335 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-422ae114-5047-4a79-b27c-dc70facac52c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:20.305736 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-422ae114-5047-4a79-b27c-dc70facac52c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1095 microversion: 2.1 time: 0.079852 Aug 06 01:50:20.306343 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 636/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:20 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:21.326247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:21.326880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:21.333670 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:21.334199 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:21.334645 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:21.335336 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:21.335843 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:21.336277 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:21.437689 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:21.446006 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e0bdc8de-e9fd-4770-b550-f7af29073670 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1201 microversion: 2.1 time: 0.124054 Aug 06 01:50:21.446592 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 617/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:21 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1201 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:22.466531 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:22.467268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:22.475249 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:22.476012 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:22.477398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:22.478166 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:22.478682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:22.479058 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:22.722060 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:22.730462 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-6a8a741a-d12f-4b7b-9084-845b47f2470f tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.267911 Aug 06 01:50:22.731023 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 637/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:22 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:22.985451 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f792fa0-b929-4ae8-8df2-3f1c1d791a71", "tag": "0d7c13c4-b334-45da-9722-85dcd24524ba"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:50:22.995734 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:22.996210 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:22.996636 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:23.007911 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] Creating event network-changed:0d7c13c4-b334-45da-9722-85dcd24524ba for instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 on hv-cinder-85200 Aug 06 01:50:23.013042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-da42ec39-05e3-4576-a116-6f71d188cea3 req-dd36e43a-ab69-4b19-b3a4-4daef132750d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165185 Aug 06 01:50:23.013663 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 618/1255] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:50:23.751823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:23.752432 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:23.759733 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:23.760206 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:23.760643 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:23.761347 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:23.761824 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:23.762243 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:23.890907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:23.898296 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-28f62ccc-1a42-4846-8bcb-dc8cbf803bf2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.150524 Aug 06 01:50:23.899152 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 638/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:23 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:24.920042 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:24.920745 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:24.926906 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:24.927388 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:24.927829 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:24.928519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:24.929032 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:24.930021 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:25.068618 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:25.076284 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-e8ec6190-5bf9-4c91-b423-1d7bcb76998c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.160905 Aug 06 01:50:25.076880 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 619/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:24 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:26.096475 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:26.097121 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:26.103562 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:26.104051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:26.104490 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:26.105215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:26.105682 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:26.106138 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:26.234363 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:26.242264 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-8165c62d-54e4-4516-819f-c7e423cf683c tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.149127 Aug 06 01:50:26.242897 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 639/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:26 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:27.263654 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:27.264263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:27.270614 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:27.271099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:27.271535 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:27.272218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:27.272669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:27.273146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:27.402939 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:27.410432 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5154838b-2c37-4a92-b346-52d97476aae2 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.150717 Aug 06 01:50:27.410996 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 620/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:27 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:28.431794 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:28.432410 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:28.438809 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:28.439298 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:28.439737 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:28.440419 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:28.440872 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:28.441325 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:28.574648 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:28.582022 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-80a61cd6-d327-4dc2-a635-3b1cd4490b44 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.154577 Aug 06 01:50:28.582586 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 640/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:28 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:29.602842 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:29.603462 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:29.609822 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:29.610320 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:29.610765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:29.611480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:29.612061 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:29.612508 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:29.740437 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:29.748550 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-5cb00609-4d40-4de5-8e7c-21b5a4278056 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.150458 Aug 06 01:50:29.749473 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 621/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:29 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:30.771268 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:30.771890 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:30.775017 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell0:SELECT=2 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:30.780183 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:30.780676 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:30.781132 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:30.781823 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:30.782279 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:30.782706 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:30.920876 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:30.928513 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-24915eb6-a4c5-4fd0-a324-b43cb1a0161e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.161033 Aug 06 01:50:30.929201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 641/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:30 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:31.948833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:31.949541 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:31.951495 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=2 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:31.952146 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell0:SELECT=6 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:50:31.958341 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:31.958828 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:31.959263 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:31.959958 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:31.961079 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:31.961531 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:32.098033 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:32.105525 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2f01c6e5-5872-4d3f-baeb-9139f0ea4f2b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.161132 Aug 06 01:50:32.106099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 622/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:31 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:33.127104 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:33.127647 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:33.135193 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:33.135690 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:33.136136 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:33.136839 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:33.137336 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:33.137770 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:33.268754 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:33.277398 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-5d9c1cce-dacb-48be-9291-32689f29610b tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.154413 Aug 06 01:50:33.277979 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 642/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:33 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:34.297891 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:34.298538 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:34.306368 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:34.306862 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:34.307300 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:34.308031 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:34.308489 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:34.308920 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:34.442953 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:34.450565 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-536e2cdb-c502-4fe0-aa76-a2484beb2c6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.156631 Aug 06 01:50:34.451171 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 623/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:34 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:34.900403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f792fa0-b929-4ae8-8df2-3f1c1d791a71", "name": "network-vif-plugged", "status": "completed", "tag": "0d7c13c4-b334-45da-9722-85dcd24524ba"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:50:34.909915 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:34.910308 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:34.910741 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:34.921456 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] Creating event network-vif-plugged:0d7c13c4-b334-45da-9722-85dcd24524ba for instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 on hv-cinder-85200 Aug 06 01:50:34.926478 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-a42fb6c4-b3f6-4aa2-96f1-5e8cb87f0385 req-ebd263fd-0047-46cf-87a4-ff75076c00a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230052 Aug 06 01:50:34.927070 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 643/1266] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:50:35.471925 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:35.472687 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:35.480111 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:35.480613 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:35.481077 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:35.481784 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:35.482244 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:35.482673 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:35.624770 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:35.632903 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-adc736a7-db92-4679-9ed7-6497d764ca12 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1267 microversion: 2.1 time: 0.164262 Aug 06 01:50:35.633520 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 624/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:35 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:36.654554 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:36.655301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:36.661477 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:36.662124 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:36.662662 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:36.664021 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:36.664532 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:36.664972 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:36.798960 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:36.807177 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-d98f4560-5483-4955-a04d-d1abd8180c37 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1455 microversion: 2.1 time: 0.157362 Aug 06 01:50:36.807752 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 644/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:36 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:36.827580 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:50:36.828189 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:50:36.834484 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:36.834962 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:36.835974 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:36.836669 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:36.837165 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:36.837617 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:36.966534 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:50:36.975094 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-0ba15b06-6b7e-4727-ab44-3866d06d3b68 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1455 microversion: 2.1 time: 0.151253 Aug 06 01:50:36.975791 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 625/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:50:36 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:50:38.926656 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f792fa0-b929-4ae8-8df2-3f1c1d791a71", "tag": "0d7c13c4-b334-45da-9722-85dcd24524ba"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:50:38.936468 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:50:38.936940 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:50:38.937403 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:50:38.949639 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] Creating event network-changed:0d7c13c4-b334-45da-9722-85dcd24524ba for instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 on hv-cinder-85200 Aug 06 01:50:38.954635 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-9be9d3e2-2b32-4c89-813b-340f145e82eb req-3d9582f6-1d2f-40d5-aa14-c034d6d24f09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031641 Aug 06 01:50:38.955248 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 645/1270] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:51:14.608402 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:51:14.609103 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:51:18.143496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:51:18.143496 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:52:43.170275 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:43.170853 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR oslo.messaging._drivers.impl_rabbit [-] [600a5544-3ede-48cc-848e-a9043b885980] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 01:52:43.171246 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:43.171350 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_api:SELECT=22 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:52:43.172153 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG dbcounter [-] [124313] Writing DB stats nova_cell1:SELECT=46 {{(pid=124313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:52:43.174486 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48d1d4a1-1d63-4bf3-bac3-ae448e081272] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 01:52:43.175036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:52:43.175681 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG dbcounter [-] [124314] Writing DB stats nova_cell1:SELECT=52 {{(pid=124314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:52:43.179289 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:43.179933 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:43.180207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:43.180916 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:43.181482 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:43.181915 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:43.211653 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Going to try to terminate instance {{(pid=124314) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:52:43.306130 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-8c043520-fbf4-4b5d-b95b-8e1d03f3e5f6 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 204 len: 0 microversion: 2.1 time: 0.140540 Aug 06 01:52:43.306638 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 626/1271] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:52:43 2022] DELETE /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:52:43.316036 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:43.316780 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:43.322847 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:43.323334 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:43.324104 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:43.324458 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:43.325965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:43.325965 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:43.409010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f792fa0-b929-4ae8-8df2-3f1c1d791a71", "tag": "0d7c13c4-b334-45da-9722-85dcd24524ba"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:52:43.425698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:43.426201 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:43.427205 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:43.442624 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] Creating event network-changed:0d7c13c4-b334-45da-9722-85dcd24524ba for instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 on hv-cinder-85200 Aug 06 01:52:43.448426 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-8733f51d-3dcb-41c1-a83c-1e99a8f0b326 req-a79c74f8-452f-4f32-a252-dbf3e20b67a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279721 Aug 06 01:52:43.449326 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 646/1272] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:52:43.485587 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:43.493961 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-29f3fa6e-a75c-462a-9928-77f73a634a90 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1579 microversion: 2.1 time: 0.182209 Aug 06 01:52:43.494548 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 627/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:43 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:44.517355 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:44.518051 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:44.525290 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:44.525779 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:44.526215 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:44.526907 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:44.527361 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:44.527862 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:44.531629 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] [600a5544-3ede-48cc-848e-a9043b885980] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45558. Aug 06 01:52:44.694738 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:44.703951 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-0d24686c-a2e6-43c7-8e2c-3a2f9157b1e0 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1579 microversion: 2.1 time: 0.192140 Aug 06 01:52:44.704541 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 647/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:44 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:45.725747 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:45.726449 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:45.735114 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:45.735607 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:45.736052 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:45.736759 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:45.737247 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:45.737684 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:45.745084 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] [48d1d4a1-1d63-4bf3-bac3-ae448e081272] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45562. Aug 06 01:52:45.830959 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:45.840823 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1452c558-8fab-434b-a83b-f0ff836850bf tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 200 len: 1393 microversion: 2.1 time: 0.118239 Aug 06 01:52:45.841767 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 628/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:45 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 1393 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:45.842812 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f792fa0-b929-4ae8-8df2-3f1c1d791a71", "name": "network-vif-deleted", "tag": "0d7c13c4-b334-45da-9722-85dcd24524ba"}]} {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:52:45.853353 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:45.854055 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:45.854489 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:45.867748 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.compute.server_external_events [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] Creating event network-vif-deleted:0d7c13c4-b334-45da-9722-85dcd24524ba for instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 on hv-cinder-85200 Aug 06 01:52:45.872691 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [req-2333f400-29f4-44e9-a505-d7752f168525 req-0f78e126-705b-4a48-bd3e-6c29c77a07d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034310 Aug 06 01:52:45.873399 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 648/1276] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 01:52:46.862914 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:46.863528 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 7f792fa0-b929-4ae8-8df2-3f1c1d791a71] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:46.869838 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:46.870317 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:46.870752 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:46.871445 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:46.871894 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:46.872318 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:46.885574 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] HTTP exception thrown: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Request method failure captured: Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 HTTP/1.1 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ceI_C2-c7Vj0aQSAjlvN7agCWqEZR32VVciYWVClRhqS8t0C_A-use7UGOUx3R0CzEMtkVeJgIw8ZlLcGgrsPWSbWONphGNljb87fE27f1HXs_Noes9YOzOoc1PXGVUuWxdNV9ooBSp78bZdlF9glHP7xKdC0OtquN9Bd-AxhSilnw Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:52:46.887833 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}] Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 6ac05cb43bb146cbb0a548ff3148a77a Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. Aug 06 01:52:46.889700 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '7f792fa0-b929-4ae8-8df2-3f1c1d791a71'} Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:52:46.890942 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. Aug 06 01:52:46.892788 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:46.894359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Returning 404 to user: Instance 7f792fa0-b929-4ae8-8df2-3f1c1d791a71 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:52:46.894359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-1b024404-cbb5-4fcb-adcc-d67af14c4f6d tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71" status: 404 len: 111 microversion: 2.1 time: 0.030244 Aug 06 01:52:46.894359 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 629/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:46 2022] GET /compute/v2.1/servers/7f792fa0-b929-4ae8-8df2-3f1c1d791a71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:52:49.971032 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:49.971607 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:49.973970 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b92da12-7de0-4665-ab69-660d55eadde7", "tag": "7069deae-4b84-4d2b-8ec0-d4dbf9f163f2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:52:49.978239 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:49.978717 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:49.979147 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:49.979827 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:49.980458 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:49.981515 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:49.984480 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:49.984966 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:49.985421 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:49.997363 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] Creating event network-changed:7069deae-4b84-4d2b-8ec0-d4dbf9f163f2 for instance 3b92da12-7de0-4665-ab69-660d55eadde7 on hv-cinder-85200 Aug 06 01:52:50.003207 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-5aa6cffd-d8f3-4f88-8ad3-d754cabbb803 req-48eea56a-427a-4707-b523-d34c92ebc78d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033202 Aug 06 01:52:50.003779 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 630/1278] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:52:50.009015 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Going to try to terminate instance {{(pid=124313) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 01:52:50.098675 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a67c49ab-2157-4329-983d-49d0a0b7a65e tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 204 len: 0 microversion: 2.1 time: 0.130926 Aug 06 01:52:50.102725 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 649/1279] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:52:49 2022] DELETE /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 01:52:50.109646 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:50.110384 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:50.116524 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:50.116995 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:50.117470 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:50.118163 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:50.118616 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:50.119039 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:50.264218 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.policy [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:50.271765 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-36746938-73f2-427c-a6de-8ab9f82a45a9 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1579 microversion: 2.1 time: 0.166874 Aug 06 01:52:50.272347 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 631/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:50 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:51.294604 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:51.295301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:51.301628 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:51.302111 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:51.302548 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:51.303236 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:51.303692 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:51.304117 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:51.474571 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:51.482718 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-af64c1d4-65e4-40f5-9381-6ce69a1a98c4 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1579 microversion: 2.1 time: 0.192893 Aug 06 01:52:51.483291 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 650/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:51 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:52.430561 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b92da12-7de0-4665-ab69-660d55eadde7", "name": "network-vif-deleted", "tag": "7069deae-4b84-4d2b-8ec0-d4dbf9f163f2"}]} {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 01:52:52.443789 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:52.444266 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:52.445517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:52.457816 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.compute.server_external_events [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] Creating event network-vif-deleted:7069deae-4b84-4d2b-8ec0-d4dbf9f163f2 for instance 3b92da12-7de0-4665-ab69-660d55eadde7 on hv-cinder-85200 Aug 06 01:52:52.462719 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [req-787978f7-5663-44b8-b644-95608c41d094 req-4a126b9c-1af5-4994-8c18-43f96300b340 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035786 Aug 06 01:52:52.463324 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 632/1282] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Aug 6 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 01:52:52.503558 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:52.504199 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:52.511726 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:52.513259 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:52.514310 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:52.515175 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:52.515785 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:52.516114 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:52.577909 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.policy [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac05cb43bb146cbb0a548ff3148a77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bea2c3f927a4bccb59065a8380b98c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124313) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 01:52:52.585441 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-a60c730f-5c3a-451c-b966-b17441f52bc3 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 200 len: 1226 microversion: 2.1 time: 0.085934 Aug 06 01:52:52.586010 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 651/1283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:52 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 01:52:53.607483 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:53.608198 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 3b92da12-7de0-4665-ab69-660d55eadde7] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:53.614234 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:53.614711 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:53.615140 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:53.615820 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:53.616269 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:53.616690 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:53.629952 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] HTTP exception thrown: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Request method failure captured: Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 HTTP/1.1 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ceI_C2-c7Vj0aQSAjlvN7agCWqEZR32VVciYWVClRhqS8t0C_A-use7UGOUx3R0CzEMtkVeJgIw8ZlLcGgrsPWSbWONphGNljb87fE27f1HXs_Noes9YOzOoc1PXGVUuWxdNV9ooBSp78bZdlF9glHP7xKdC0OtquN9Bd-AxhSilnw Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:52:53.631529 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}] Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 6ac05cb43bb146cbb0a548ff3148a77a Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. Aug 06 01:52:53.633259 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '3b92da12-7de0-4665-ab69-660d55eadde7'} Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:52:53.634304 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. Aug 06 01:52:53.636037 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:53.638338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Returning 404 to user: Instance 3b92da12-7de0-4665-ab69-660d55eadde7 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:52:53.638338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-4f2a4267-de0a-4772-9577-69ff6d503c28 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7" status: 404 len: 111 microversion: 2.1 time: 0.030288 Aug 06 01:52:53.638338 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 633/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:53 2022] GET /compute/v2.1/servers/3b92da12-7de0-4665-ab69-660d55eadde7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:52:54.075850 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:54.076407 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.compute.api [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124313) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:54.082898 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:54.083382 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:54.083822 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:54.084517 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:54.084975 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:54.085439 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG oslo_concurrency.lockutils [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:54.099062 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.wsgi [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] HTTP exception thrown: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Request method failure captured: Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: request: DELETE /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 HTTP/1.1 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept: application/json Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Accept-Encoding: identity Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Connection: close Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Length: 0 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Content-Type: application/json Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Host: 10.222.0.26 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Openstack-System-Scope: None Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: User-Agent: python-urllib3/1.26.11 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Auth-Token: gAAAAABi7ceI_C2-c7Vj0aQSAjlvN7agCWqEZR32VVciYWVClRhqS8t0C_A-use7UGOUx3R0CzEMtkVeJgIw8ZlLcGgrsPWSbWONphGNljb87fE27f1HXs_Noes9YOzOoc1PXGVUuWxdNV9ooBSp78bZdlF9glHP7xKdC0OtquN9Bd-AxhSilnw Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Id: None Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Domain-Name: None Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Identity-Status: Confirmed Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Is-Admin-Project: True Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Id: default Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Domain-Name: Default Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Project-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Role: member,reader Aug 06 01:52:54.100698 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Roles: member,reader Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}] Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-Tenant-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Id: default Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Domain-Name: Default Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Id: 6ac05cb43bb146cbb0a548ff3148a77a Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: X-User-Name: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: method: > Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: exception: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.102516 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: action_args: {'id': '19b9f5c4-7b27-470b-baf3-0c427b43e4f4'} Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:52:54.103681 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.105316 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.107429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Returning 404 to user: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. {{(pid=124313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:52:54.107429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-961f7cdb-00c0-4234-af29-027425e8f548 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 404 len: 111 microversion: 2.1 time: 0.030923 Aug 06 01:52:54.107429 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 652/1285] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Aug 6 01:52:54 2022] DELETE /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:52:54.110594 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '>' {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:54.111208 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.compute.api [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] [instance: 19b9f5c4-7b27-470b-baf3-0c427b43e4f4] Fetching instance by UUID {{(pid=124314) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 01:52:54.117000 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:54.117519 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:54.117954 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:54.118642 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Acquiring lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 01:52:54.119095 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 01:52:54.119517 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG oslo_concurrency.lockutils [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Lock "63b0eb87-9452-4c97-8ca1-d697fc2186af" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 01:52:54.135193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.wsgi [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] HTTP exception thrown: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Request method failure captured: Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: request: GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 HTTP/1.1 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept: application/json Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Accept-Encoding: identity Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Connection: close Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Length: 0 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Content-Type: application/json Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Host: 10.222.0.26 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Openstack-System-Scope: None Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: User-Agent: python-urllib3/1.26.11 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Auth-Token: gAAAAABi7ceI_C2-c7Vj0aQSAjlvN7agCWqEZR32VVciYWVClRhqS8t0C_A-use7UGOUx3R0CzEMtkVeJgIw8ZlLcGgrsPWSbWONphGNljb87fE27f1HXs_Noes9YOzOoc1PXGVUuWxdNV9ooBSp78bZdlF9glHP7xKdC0OtquN9Bd-AxhSilnw Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Id: None Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Domain-Name: None Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Identity-Status: Confirmed Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Is-Admin-Project: True Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Id: default Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Domain-Name: Default Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Project-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Role: member,reader Aug 06 01:52:54.136693 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Roles: member,reader Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bea2c3f927a4bccb59065a8380b98c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bea2c3f927a4bccb59065a8380b98c9"}]}] Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Id: 3bea2c3f927a4bccb59065a8380b98c9 Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-Tenant-Name: tempest-TestVolumeBootPattern-584244258 Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Id: default Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Domain-Name: Default Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Id: 6ac05cb43bb146cbb0a548ff3148a77a Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: X-User-Name: tempest-TestVolumeBootPattern-584244258-project Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: method: > Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: exception: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.139452 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: action_args: {'id': '19b9f5c4-7b27-470b-baf3-0c427b43e4f4'} Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: {{(pid=124314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 01:52:54.140491 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. Aug 06 01:52:54.142213 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: ERROR nova.api.openstack.wsgi Aug 06 01:52:54.143635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: DEBUG nova.api.openstack.wsgi [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Returning 404 to user: Instance 19b9f5c4-7b27-470b-baf3-0c427b43e4f4 could not be found. {{(pid=124314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 01:52:54.143635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO nova.api.openstack.requestlog [None req-2d84c0e7-779e-4166-bcc3-1d44c5fba214 tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4" status: 404 len: 111 microversion: 2.1 time: 0.031812 Aug 06 01:52:54.143635 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: [pid: 124314|app: 0|req: 634/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Aug 6 01:52:54 2022] GET /compute/v2.1/servers/19b9f5c4-7b27-470b-baf3-0c427b43e4f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 01:52:55.435986 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: DEBUG nova.api.openstack.wsgi [None req-b1fc4871-3a8e-4df4-a965-2c95cabd7ace tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] Calling method '.version_select at 0x7fbff7e6db80>' {{(pid=124313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 01:52:55.463444 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO nova.api.openstack.requestlog [None req-b1fc4871-3a8e-4df4-a965-2c95cabd7ace tempest-TestVolumeBootPattern-584244258 tempest-TestVolumeBootPattern-584244258-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1895415522" status: 202 len: 0 microversion: 2.1 time: 0.031112 Aug 06 01:52:55.464072 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: [pid: 124313|app: 0|req: 653/1287] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Aug 6 01:52:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1895415522 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 01:53:02.966472 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:53:02.967099 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:53:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:53:38.603311 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:53:38.603973 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:53:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:54:34.616627 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:54:34.617245 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:54:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:56:22.974530 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:56:22.975193 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:56:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:56:58.611050 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:56:58.611675 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:56:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:57:54.625315 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:57:54.625905 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:57:58.155702 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:57:58.156301 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:58:06.689355 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:58:06.689956 dv-cinder-852009-1-iscsi devstack@n-api.service[124314]: Sat Aug 6 01:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 01:58:24.054125 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 01:58:24.054721 dv-cinder-852009-1-iscsi devstack@n-api.service[124313]: Sat Aug 6 01:58:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!